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PROLOGUE 



One of the most conspicuous and indeed alarming features of modern 
life is the rapid growth, proliferation, and diffusion of knowledge in every 
area of human endeavour. This is having an impact upon individuals and social 
institutions more profound than one can conceive or readily accept. It is 
producing changes that erode cherished myths about education which destroys 
personal and institutional security. 

Individuals can no longer enjoy the security that is based on levels 
of educational attainment for new knowledge quickly makes past learning 
obsolete. The higher the original level of educational achievement, the more 
quickly obsolescence occurs; consequently, the several professions are more 
significantly threatened by change. At the same time, the accepted roles of 
social institutions are undermined. As new knowledge permeates all segments 
of society it alters the function and purpose of each institution in its 
relationship to others and to society in general. The firmly entrenched insti- 
tutions are most threatened since their security is based on traditional 
responses to problems which new knowledge has made obsolete. 

To survive in a changing world, both individuals and institutions must 
continue to learn. Such learning does occur but as DeCrow* has noted, much 
of it 

...is happening unintentionally, largely unobserved, and without 
the slightest conscious direction. It is happening of necessity, 
almost as a reflex motion of a society grappling with social forces 
which are remoulding a nation to confront the challenges of a rapidly 
changing world- 



R. DeCrow, "The Scope of Continuing Education.". Continuing Education 
f January, 1969) pp. 5 & 9. 



But learning cannot be left to chance and without "...the slightest 
conscious direction." There is too much to be learned, too little time to 
learn it in, and too many distraction in the work-a-day world to ensurt: 
that the learning required will ' a ac d. In the past, such learning 

to keep abreast of new knowledge wci£> Lnought to be an individual responsi- 
bility but few individuals accepted that responsibility so that the majority 
became obsolete and dysfunctional in a changing society. Consequently, it 
is becoming increasingly obvious that continuous learning is a responsibility 
that must be shared by both individuals and by society. 

Some individuals and institutions have accepted this responsibility 
for continuing education more readily thafi have others and over a longer 
period of time. Adult education has been an integral part of society for 
centuries but for the most part it has existed outside the institutional 
structure as an activity of individuals concerned about their oxm personal 
need for systematic learning opportunities or with a philanthropic concern 
for the needs of others. It is only within the past century that educational 
institutions have begun to. accept a responsibility for continuing education 
but not yet to the extent that it helps shape the self-image of the insti- 
tutional role and function in society. At the moment, adult education is 
still largely a marginal activity. 

The several health professions are just now becoming aware of their 
role in and responsibility for the continuing education of their members. 
For the most part this has been forced on them and accepted with some 
reluctance through fear of losing control of their own destiny to other 
forces in society. In implementing this newer responsibility the health 
professions have not modified their traditional perceptions of learning 



and education in light of new scientific knowledge about adult education 
so that their continuing education programs do not usually achieve the 
learning and changes in behavior necessary for improved patient care. 

The scientific and socio-economic factors accentuating the need 
for continuing education in the health professions has been well documented 
in many health manpower reports and by numerous leaders in the health 
field. Research is producing new knowledge in the health field at an un- 
relenting pace. Science has made massive strides in the understanding, 
cure,. and prevention of ill health so that life expectancy has been increased 
two-fold. At the same time, it has become increasingly apparent that new 
and better means must be found to hasten the application of new knowledge 
for the improvement of health care. 

An increasingly informed public aware of new discoveries and de- 
manding them has accentuated the need to hasten the spread and use of knowl- 
edge. Higher education and income levels, as well as expanded coverage by 
health insurance schemes is shifting the role of the consumer as 'patient' 
to that of "buyer ' thereby strengthening his position to demand more and 
better health services. A growing egalitarianlsm now views health as a 
basic human right which should be readily available to all with equal 
quality. 

In response to the changing nature of public expectations, univer- 
sities and professional associations, joined by health service agencies and 
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institutions, are atteippting to prevent obsolescence by increasing their 
involvement in continuing education. Although some interest and activity 
in continuous learning has long been the concern of some individual mem- 
bers of the health professions, it is only within the past decade that 
professional groups have concentrated iiheir attention upon the provision 
of systematic educational opportunities for all in the professions, 
la spite of this rapidly growing interest and concern it is 
everywhere apparent that continuing education is a responsibility not 
yet discharged satisfactorily or adequately at all levels. Moreover, as 
noted by Houle*: 

...even more disconcerting is the expression of a growing public 
hostility toward the several professions because of the alleged 
incompetence or self-satisfaction of their individual members, 
faults which better continuing professional education might have 
helped to prevent. 

Although the case is not clear, the view is expressed widely that 
continuing education in the health sciences suffers from a lack of clear 
purpose, an absence of professional interest, and incompetence in the 
provision and conduct of educational activities. There is also widespread 
the impression that programs are ad hoc or piecemeal instead of continuing, 
and designed along the traditional lines of youth education rather than 
taking into account that the potential participants are adults. 

Whatever the crux of the problem, the general consensus is that 
present programs have many shortcomings and that newer and more effective 
approaches must be found. Recent government reports recommending that 

* CO. Houle, "To Learn the Future" • Medical Clinics of North America, 
54: 5-17, (January 1970). 

o 
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"...professional associations explore the means whereby continuing ed- 
ucation could be made a condition for practice*.." have added a new 
sense of urgiency to the task. 

NEW DIRECTIONS 

At present, programs for continuing education in the health 
professions are constructed largely on the model of academic pre-*pro- 
fessional education which is controlled exclusively by subject matter 
and conducted primarily to disseminate information • This approach to 
learning stems from the prior educational experience of those planning 
the program as they generally lack sufficient knowledge about adult 
learning and instruction to do otherwise. Furthermore, as a result of 

i 

their prior experience in pre-prof essional education, those for whom 
programs are planned resist educational activities that violate tradi- 
tional conceptions regardless of their efficacy for learning. Since the 
traditional approach to education is not fulfilling the need, continuing 
education for health professionals must seek new directions. 

^ In order to design new directions, it is necessary to examine 
existing activities in continuing education. This review, therefore, is 
a summary and analysis of the literature on continuing education in the 
health professions from 1960 to 1970 in order to provide a basis to seek 
new directions. By studyiniS existing patterns of education for the pro- 
fessions it will be possible to avoid earlier mistakes and profit from 
prior experiences in designing functional educational programs. 

/ 



CLARIFICATION OF TERMS 



The term continuing education has been defined in various ways 
in the health sciences • Some definitions are broad and encompass all 
education following the completion of pre-prof esslonal programs in under- 
graduate study. In other cases, the term is defined in a very restrictive 
sense to apply only to short refresher-type courses c Still others use 
the term as a synonym of adult education to Include all learning activities 
which contribute to personal growth and development. 

^ As used In this review, continuing education includes any edu- 

\ 

\catlonal activity for health professionals through which opportunities 

for systematic learning are provided". Thus, any planned learning experi- 
ence is Included in this term and these range from formal courses through 
conferences, conventions, institutes, or workshops, to clinical trainee- 
ship so long as they are conducted for practising professionals and are 
systematic learning activities. 

Instructional devices such as recordings, films, television, radio 
or programmed instruction are also included in this review where appropriate. 
For the most part such devices are used principally as information sources, 
to aid in self -instruction, or as ways of extending the range of an instruc- 
tor to include widely dispersed participants. 

The terms course and program are used interchangeably In this 
xevle^ and refer to those learning activities which isre designed to achieve 
specific instructional objectives within a specified period of time. 



Thus, a program may consist of a single instructional event such as an 
evening meeting or a one day institute, or it may be a sequential series 
of events occurring regularly over a period of time- 

The tsrros method and technique are generally used interchangeably 
iti the literature without specification- A n^th od is a way of organizing 
the participants for the purpose of conducting a learning activity and may 
include correspondence study, classes, workshops, ward rounds, or clinical 
trsineeships . A technique , on the other hand, identifies the behaviors 
that occur in the iisstructional situation which are Intended to help the 
participant learn and includes such things as the lecture, panel, symposium, 
discussion, demonstration and similar actions. 

Learning is u^ed here to identify the process through which an 
individual acquires a new capability thalt is a more or Less permanent 
change in behavior resulting from experience' suach as acquiring new informa- 
tion, a new skill, or an attitude - 

The term instrm^tion is used to identify the action of an agent 
who designs and manages a learning activity in order to achieve greater 
success in learning • 

LIMITATIONS 

This review is primarily concerned with basic program development 
for continuing education in the health prof essSions . Most of the literature 
reviewed has been descriptive in nature covering a single program or a survey 
of program activities^ There has been very li^fcfgibB done in the -way of sub-- 



stantive research and such as is available of. fails to satisfy the 
rigorous canons of social science so that there is little validity or 
reliability in the data or conclusions presented. Perhaps if it accom- 
plishes no other useful purpose, this review may spur the several pro- 
fessions to engage in research that is functional in answering the many 
problems identified In the literature. 



PART TWO 
CONTINUING EDUCATION IN MEDICINE 



•CHAPTER I 



THE PROFESSION AND CONTINUING EDUCATION 

In keeping with the rapidly changing nature of science and society, 
medicine has undergone, and continues to undergo many changes, all of which 
must be reflected in education at all levels. In both Canada and the United 
States the number of active physicians has been increased over the past 
few decades, but this is offset by the fact that the number of patients 
seeking medical care has increased proportionately (171) (243). Moreover, 
despite the immigration of foreign doctors to maintain what is considered 
to be an optimum physician/population ratio, unequal distribution and 
utilization of physicians has created a disparity between demand and supply 
(171). ' 

PHYSICIAN COMPOSITION AND DISTRIBUTION 

An analysis of medical manpower in the United States reveals that 
the number of physicians employed in teaching, research, administration, and 
other activities unrelated to direct patient care, has been increasing in 
recent decades while the number in private practice is declining (171). 

Changes in the pattern of providing medical care have also occurred 
within private practice. In the United States, the number of general prac- 
titioners*declined from roughly 50 percent of the total number of physicians 

* As used in this study, "General Practitioner" refers to those M.D.'s with 
no specialty training and/or those with some specialty training, but who 
y not board certified, and who do not limit their practice to a single field. 



in 1959, to approximately 31 percent in 1967* Current information on 
physician manpower in Canada reveals a similar trend. Whereas in 1965 
the percentage of physicians in general practice was 67 percent, in 1968 
the figure had dropped to approximately 54 percent (243) • 

Since some of the services formerly provided by general prac- 
titioners are being redistributed among the specialties, and other health 
workers (92) (134) (195) , the implications of this changing pattern are 
not clear. Nevertheless, most reports stress the growing concern of both 
the public and the medical profession over the declining numbers of phy- 
sicians in general practice, . and many authors (96) (195) (257) reiterate 
the recommendation- of the Millis report (163) , that a new type of general- 
ist be prepared who has graduate training in family medicine. 

Of equal concern are the wide regional differences in the supply of 
physicians in relation to population. Doctors tend to concentrate in the 
larger urban areas and it is estimated that over one half of all doctors 
are presently practising in communities with populations in excess of 
100,000 (257). This disproportionate distribution is also found at the 
state and provincial levels, varying directly with the per capita income 
and the proportion of the population in urban communities. Thus, while the 
physician/population ratio in Canada in 1971 was 1:723, British Columbia 
has the most favourable ratio of 1:638, followed by Ontario with 1:717, 
and Newfoundland with the least favourable ratio of 1:1,199* 
Work Patterns : 

A number of recent surveys (127, 232, 242, 257) disclose thaf ' 
physicians average a 56 to 63 hour work week, of which roughly 80 percent 



is spent in direct patient care. The remaining 20 percent or less of the 
physician's time is spent in office administration, continuing education, 
medical society and hospital meetings, research and/or teaching. Contrary 
to the popular belief that office practice is decreasing, studies reveal 
that physicians average more than twice as many patient-physician contacts 
through office visits than they do through hospital visits (16, 127, 242), 
While generalizations cannot be made from the limited' data provided, most 
authors agree with Somers (232) that "One limit in the doctor's product- 
ivity we have almost surely reached* . . the number of hours that he can be 
expected to work." 
Changing Patterns of Practice ; 

Group practice, which brings together general practitioners and 
specialists who can share their expertise, facilities , and the services 
of supporting personnel, is a logical development to offset the frag- 
mentation of care resulting from increased specialization (163) • Such 
arrangements should also lead to the sharing of on call time, thus lessening 
the lengthy work week of physicians to some degree. Despite these ad- 
vantages, the adoption of group practice has been relatively slow in both 
Canada and the United States (195) (232). Moreover, there is no con- 
clusive evidence that group practice does in fact improve the efficiency 
or effectiveness of medical care (171) . 

On the other hand, the major development in the organization of 
medical practice has been the trend toward hospital based services (232) . 
Without elaborating on the nature of this trend, it is worth noting that 
there has been an increasing number of articles and reports reflecting the 
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growing internal as well as external contradictions of the medical care 
system* There are many comments about the inequities in hospital priv^ 
ileges, interprofessional stresses and strains, and the soaring costs of 
hospital care (183) (196) (232) (243). Furthermore, ii. t^as been said that 
the hospital system is more producer than consumer ^ en .ed , and that it 
has been so busy "keeping in step with medical adva^iCes, that it has lost 
step with the medical needs of the community" (232) (252). 

The charge is heard increasingly that while medical science now 
has the knowledge and technology to promote effective "health medicine", 
the bulk of medical practice is disease or cure oriented (195) (243) ^ 
As indicated by the Task Force on Health Costs in Canada (243) "more than 
95 percent of health costs are spent on hospital and medical care services, 
the treatment component, while public health and the preventive aspects 
constitute less than 5 percent." 

The Report of the Committee on the Healing Arts (195) defines the 
problem in concrete termis : 

This is not the fault of the individual practitioners: most are 
already overworked in providing curative services. It is the 
fault rather, of a health system in which medical schools have 
failed to emphasize preventive health... and in which the rewards 
in income and professional status are relatively lower in this 
type of work than for other aspects of medical practice. Further- 
more, and more importantly, the system is ill organized for the 
provision of comprehensive health care... The medical technology 
is now divided among poorly co-ordinated groupings of practi- 
tioners and agencies, specialists, general practitioners, hos- 
pitals, community services, and public health agencies. 

The issues and problems of the medical care system are enormously 
complex and will not soon be resolved. At the same time, as noted by 
Storey (237) "any attempt to improve medical practice through continuing 
education must take into account the existing system, and relate effective 
education to that system." 

ERIC 
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NEED FOR CONTINUING EDUCATION 
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Three discrete phases of education are distinguishable in the 
field of medicine: undergraduate education leading to the M.D. degree; 
graduate education covering the interneship, residency, or other full 
time study leading to advanced academic degrees or medical specialties; 
and continuing education, comprising those activities engaged in by 
practising physicians "both to refresh the individual in various aspects 
of his basic medical education, and to inform him of new developments 
in his own and related fields of medical practice, but whichi do not 
lead to any formal advanced standing in the profession" (51). This 
third phase, frequently referred to as the "last Undeveloped frontier of 
medical education," is the concern of this review. 

The problem of keeping up with the research revolution is par- 
ticularly acute in medicine where new developments are occurring, perhaps 
more rapidly than in v'^.ny other field. The physician is confronted by ever 
Increasing demands of a busy practice and by the omnipresent threat of 
obsolescence. Although organized medicine has invested money, manpower, 
and time, in attempting to help physicians keep current, the returns from 
this investment are now being questioned. Manning (145) and others 
(86, 194, 222, 275) estimate that only 10 to 25 percent of the practising 
physicians engage in continuing education despite the multitude of 
opportunities available to them. To what extent the quality and tech^- 
niques of postgraduate medical education are responsible for this 
seeming disinterest is unclear, nor is it known how many of those 
physicians who do participate actually benefit from the programs offered. 
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Although much has been written about the nature of the problem there is 
insufficient reliable data to understand the problem. 

Continuing education in medicine is not without its landmarks. 
Indeed > most of the problems being debated and the concepts currently 
considered to be new or revolutionary have been recognized and documented 
in a number of studies and imaginative reports published in the last 
half century. 
E arly Developments ; 

In his historical chronology, Sheperd (227) reports that prior 
to 1930, continuing medical education was largely directed toward cor- 
recting deficiencies resulting from inadequate basic medical education. 
It was not until the thirties, when the last of the proprietory schools 
closed and graduate specialty programs began to develop, that continuing 
education came to be viewed as the necessary 'third stage in the life-long 
education of the physician." In 1930 and 1931, the University of Michigan, 
Albany College, and Tufts University, initiated planning for regional 
continuing medical education programs. Dr. Benjamin Homing's descrip- 
tion of the early Michigan program defines precisely the concept of 
regionalization advocated today (108). 

The University of Michigan medical school has accepted the 
principles that graduate and continuing medical education 
should be decentralized and developed about the regional 
and community hospitals, and that medical education channels 
should extend from the medical schools out through such 
hospitals to the rural physicians. 

A report by the Commission on Medical Education of the American 
Medical Association published in 1932 (227) noted: 

ERLC 
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1. That the education sequence from premedical education to 
retirement from practice be looked upon broadly as a single 
problem, not a succession of isolated and unrelated exper- 
iences . 

2. That the continued education of physicians is synonymous with 
good medical practice, and provisions should be made ultimately 
whereby every physician will be able t continue his education. 
The time may come when every physician may be required in tte 
public interest to take continuation courses to insure that 
his practice will be kept abreast of current methods of diag- 
nosis, treatment, and prevention. 

3. That the problems of postgraduate medical education are 
closely interwoven with those of practice and education. 
The great need at the moment Is to secure joint leadership 
in a program which will embody the educational ideals and 
methods of the university and the highest type of medical 
practice. 

Others repeating these admonitions and recommendations were J. H. 
Upham (250) in 1937, and Rappelye (227) in 19A0 who also stressed the 
need for a critical re-examination of existing programs to determine -whether 
they were meeting the needs of practising physicians. 

A significant landmark in the historical evolution of continuing 
medical education was a program evaluation reported by Youmans in 1935 
(280). Youmans made unannounced visits to 30 physicians who had attended 
his course several months earlier and by using a self-devised rating scale 
for measuring the quality of medical practice, he compared what he believed 
to be each participant's pre-course performance against his post-course 
performance. Although the small sample and crude methodology limited his 
findings, the study is important because it appears to be the first attempt 
at program evaluation using a research approach. Two observations by 
Youmans relative to the teaching-learning process were: "...the decided 
superiority of the practical over didactic teaching. . .It was very apparent 
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that the work which dealth with patients in the wards and in the out- 
patient departments or with various technical procedures of diagnosis 
and treatment, were the most valuable part of the teaching," and "The 
teacher of the physician student must possess not only knowledge but 
also a sympathetic appreciation of the problems and limitations imposed 
on the practitioners by a busy practice." 

In 1938, the Council of Medical Education and Hospitals of the 
American Medical Association conducted the first national survey to 
determine the nature of existing postgraduate programs. The report of 
this study revealed that circuit type courses were being used in ten 
of the states visited (191), It noted that: "Under this, arrangement, 
one physician or a team of physicians would spend from one to two months 
in a region of the circuit and then move on to a new area" and that "inu- 
res idence type programs were evident throughout the country .One , two 
week or longer periods of bedside instruction of limited groups with pro- 
vision in medical schools and in hospitals for board and/or lodging, and 
intimate instructor graduate-student relationships characterize these 
short term residencies". 

The most direct outcome of this report was the decision of the 
American Medical Association to publish a nation-wide listing of pro- 
grams of continuing education available, "both as a service to physicians 
in selecting courses to attend, and as an aid to course sponsors in 
planning programs," While published first on a quarterly basis, it is 
now published annually as the "Annual Course Listing". This constitutes 
one of the major sources of information concerning the field of continuing 
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medical education in thc^Uaiu^d Staves, Thus, the decade of the thirties 
saw the emergence of a iU3isbs>7 of vex j modern ideas and several program 
innovations; nevertheless, according to Sheperd (227), educationally 
sound programs were the exce^ ion rattner than the rule in terms of the 
nation as a whole. 

Although a setbacx ire the e^wmLution of continuing medical ed- 
ucation occurred with the onsB^t of World War II, this is thought to 
have had some long range benefits in that it "forced the medical schools 
and hospitals to re-examine their programs with respect to their quality 
and quantity, and shifted the major responsibility for continuing medical 
education from the professional societies where it had traditionally 
belonged, to the universities and their medical schools" (168). 

One major study of the early post-war which reflected a growing 
concern for the role of the medical school in continuing medical ed- 
ucation was the 19A9 Deitrick-Berson study (45) which was a national survey 
of medical school programs including continuing medical education. The 
recommendations of this report related to continuing medical education 
were that: 1) courses should be designed so that students can actively 
participate and their performance, be evaluated; 2) courses should be 
increasingly located in medical schools; 3) medical school faculties 
should be increased to meet the increasing demands of postgraduate medical 
education; and 4) that accurate costs should be determined. 

Probably the most comprehensive and significant national study 
on continuing medical education was that undertaken for the American 
Medical Association beitweea ISSa-^igSS by Vollan (256) • Th±s study 



roducezTs a.nd consumeirs witK inf oinnat xon collected 
, at tetidance at couirses, inteirv±ews with moire thian 
rams of cont±Ti\jixng medical edvication sponsoired by 
as and oirganizations , and tlixrough a ques t ionnaiire 
ponses fscora practising physicians- The ma j oxr con— 
endations of this study are summaxrized as follows : 
du.ate Medical Education Laclcs Direction : 

ostgiradnate medical education is to develop soundly 
ssential to have the major purpose clearly under— 
he specific objectives delineated, long x^ange plans 
in the goals, and effective leadership - 

Practitioners ax"e Neglected ; 
greatest single need in this field today is for more 
ter refresher courses for general practitioners • 
hould be planned specifically for them in co—operation 
cal general practitioner groups • 

of Courses is not Consistent : 

is largely due to undue emphasis on enrollment fig— 
phazard preparation of courses and the practical limit— 
that often obstruct educational ideals. This malady 
y be corrected by an emphasis on: a) careful selection 
Ity and definite responsibility of faculty for post— 
e education; b) systematic evaluation of pos t— graduate 
g methods; and c) eventually, some forTn of accredita— 
ocedures may be necessary in this field. 

ysicians Do Not Continue Their Education ; 

best potential cure for this condition is an improve— 

the direction and quality of postgraduate courses 
o attract these physicians. The other factors to be 
red include: a) arranging patient: coverage while the 
an is away; b) finding ways to attract the physician; 
mple, certificate, compulsory attendance; and c) 
ing the attitude and habit of lifelong learning in 
ergraduate. 

an^s Time is Limited ; 

practice of medicine generally consumes 60 hours or 
M^eelc. Every effort should be made to utilize the time 
sician catx give to continuing medical education. 
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6 . Postgraduate Opportunities are Too Few and Maldlstributed : 
...90% of the hours are concentrated in six states and most 
of these are in a few large cities .Postgraduate opportunities 
should be more equitably distributed. 

Emerging from VollanVs study were a number of Important items, 

notably a Guide Regarding Objectives and Basic Principles of Continuing 

Medical Education Programs . This publication, with minor revisions, now 

serves as the statement of standards for the field of. continuing medical 

education (65) . 

Other important reports that followed Vollan's study, were those 
by Darley (70), Dryer (79), and Storey (237), all of which focussed on 
a national plan for continuing medical education. Although the recommen- 
dations of these reports have not been implemented, they collectively 
offer a sound framework for the establishment of a "university without 
walls-" 
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CHAPTER II 



PARTICIPATION IN CONTINUING EDUCATION. 

Organized systematic programs for the continuing education of 
physicians are not necessarily a new development but the tremendous 
grov^th in opportunities and interest has occurred recently. As yet 
there has been no definitive study of the educational activities of 
physicians but there have been a number of attempts to assess the amount 
of participation and the degree of physician interest* Some surveys 
have attempted to involve physicians in defining their own felt learning 
needs, and as well, to solicit their opinions with regards to how these 
needs might best be met. Most studies disclose that postgraduate courses 
are rated highly as a means of gaining new medical knowledge (117, 200, 
256) but, at the same time, the actual extent of physician participation 
is not known. The oft quoted estimates of ten to twenty-five percent 
attendance are at variance with recent surveys which suggest a more 
optimistic thirty to fifty percent attendance rate C37, 117, 263). 
Recent reports from medical schools indicate a steady increase in en- 
rollment figures over the past several years (54) • While this increase 
may not accurately distinguish the number of individual physicians attend*- 
ing formal courses, it is felt that physician participation is probably 
somewhat greater than has been generally assumed (6, 37, 50). 

Nevertheless, many medical educators express concexti that there 
remains a hard core of physicians who never avail themselves of oppor-- 
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Hiaciities for postgraduate work and will not, unless attendance is made 
mamdatory ((6, 263). On the other hand, polls reveal that the majority 
of practitioners are of the opinion that attendance should be a voluntary 
matter and ^'they are concerned by the mounting pressure to inake continuing 
edBccaxlon a condition for practice" (254, 260). 
Field of Practice : 

Most studies indicate that specialists devote more time to con- 
tiiHiing medical education than do general practitioners (42, 177, 185, 256) 
Farther, it is reported that specialists spend approximately five percent 
of their typical work week in some form of teaching and/or research, wherea 
general practitioners are said to engage in almost no formal teaching 
activities (42, 258). Vollan (256) attributed these differences, in 
part, to the longer period of formal education required for specialty 
practice, however, Peterson et^ al (185) found no significant relationishlp 
between the length or type of intarneship and subsequent postgraduate 
study habits. 

A recent California survey (37) found that when a detailed analysis 
of specialty practice was undertaken, a high percentage of the dissatisfied 
non-participants were found in select specialties, notably psychiatry, 
anesthesiology, neurosurgery, and other sub-specialties, while general 
practitioners expressed greater satisfaction with courses attended, and 
displayed greater interest in planned programs of continuing education* 
This study revealed that some specialists, particularly internists and 
surgeons (other than those in general surgery) attended courses often. 
The Indiana survey (117) disclosed no significant difference in attendance 
Sretween generalists and specialists. 



Practice Arrangements ; 

Although it is generally assumed that group practice encourages 
participation in continuing education, research findings do not support 
this assumption. At least two studies (37, 185) disclosed that while 
physicians In group practice were slightly better able to attend programs 
than were those in individual practice, the difference in participation 
was not statistically significant. In fact, one study found that while 
costs deterred relatively more physicians in solo practice from attending 
as many programs as they would like, more respondents in group arrange*- 
ments said they limited their attendance because of difficulties in 
getting away from their practices. 

Storey (237) notes that while 37 percent of the physicians men- 
tioned too many patients as an obstacle to course attendance, only 21 
percent listed the absence of a substitute physician as an obstacle. 
He attributes this seeming inconsistency to the traditional North American 
concept of "medical care as a personalized service provided by the private 
practitioner himself ^ and which therefore, cannot be easily delegated to 
others," 

On the other hand, a recent survey by the Canadian Medical 
Association (196) provides some interesting figures relative to group 
practice and continuing education. As shown in Table I, these data 
suggest that group practice promotes not only postgraduate study, but 
even more important, it provides a great variety of less formal but on- 
going opportunities for learning continuously. 



TABLE I 



QUALITY OF CARE PROCEDURE IN GROUPS 
(Canada, 1967) 



FEATURES OF GROUPS 


NO. 


PERCENT . 


Total number of groups 


2A6 


100 


Member selection 


240 


98 


Supervision of new members 


204 


83 


Clinical conferences 


151 


61 


Frequent consultations 


239 


97 


Postgraduate study 


226 


92 


Reference library 


160 


65 



SOURCE: Report of the Committee on the Healing Arts ; Volume 3, Table 
29.5; p. 171. (196) 
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Menzel, Katz, and Coleman (154) disclosed that the adoption of 
new drugs occurred on the average of two months sooner where physicians 
shared offices, than where doctors practised alone. Both Clute (46) and 
Peterson (185) found that physicians themselves frequently mentioned group 
practice as a convenient and inexpensive means of consultation. Thus, 
while group practice arrangements may not necessarily be organized to max^ 
imize attendance at formal courses, it appears to provide conditions con- 
ducive to continuous learning. 
Location of Practice ; 

Although physicians practising in rural areas no doubt experience 
more difficulty in arranging to attend programs, an increase in the size 
of the community does not necessarily correlate with increased partici- 
pation in continuing education. Conversely, several studies (37, 185, 256) 
reveal that phycicians in smaller cities and outlying districts attend 
courses more often than do those in larger metropolitan areas, and, when 
they do attend, they are more satisfied than their metropolitan peers (37). 
Rising et_ al (204) attributed the somewhat lower attendance in larger 
cities to greater dependence on hospital staff meetings as well as to the 
number of professional consultations available, while those in smaller 
communities must depend more on course attendance for new information and 
professional contacts. Both Vollan (256) and Peterson (185) made similar 
observations; however, they also found that physicians practising in the 
largest cities averaged the most hours per year in continuing education. 
Years of Practice : 

Age appears to be an important variable related to participation ■ 
ERiC continuing medical education. Both Vollan (256) and Peterson (185) 



disclosed an age related pattern of participation that was charact- 
erized by a gradual increase in the percentage of physicians attending 
postgraduate courses as the number of years in practice increased 
which reached a peak in the fifth decade and declined thereafter. More 
recent reports reveal a similar pattern but with younger physicians, 
averaging more regular attendance at formal courses (37 ^ 177). Appel 
concluded that this trend is related to the realization by younger 
physicians that they cannot "coast along for the first few years in 
practice as could their predecessors twenty years ago" (6) . Others 
suggest that this trend may be due more to deficiencies in basic medical 
education (15, 37). 

OPINIONS AND PREFERENCES 

Numerous studies have sought some measure of attitudes about 
continuing education and have attempted to identify factors in the pro- 
vision of programs which may encourage or inhibit participation. These 
include such matters as fees, scheduling, instructional processes and 
content. Most of these factors lie within the domain of those providing 
programs, consequently the findings from such surveys can provide clues 
useful in planning. 
Deterrents to Attendance ; 

The major obstacla to attendance is the inability to leave a busy 
practice rather than gross dissatisfaction with courses attended, or lack 
of available educational opportunities (34, 37, 39, 117). As might be 



expected y general practitioners experience the greatest difficulty in 
getting away for additional study (37, 117, 200). At the same time, 
they express a greater need for it than do specialists who are more 
likely to feel that the/ cau get needed informatlor through alternate 
routes. One study (37) of non-participants revealed that 81 percent 
of those physicians in surgical specialties and 60 percent in medical 
specialties indicated "get information from other sources" as their 
primary reason for not attending, while only 30 percent of the general 
practitioners listed the same reason. The primary reason for non- 
participation given by this latter group was "time committed to patients." 

Other deterrents to attendance mentioned by physicians included 
unsatisfactory scheduling of programs; costs; unsuitable subject matter 
(37) (117) (197) (229); lack of awareness of courses available (39);" 
and, that the physician felt himself to be adequately informed and not 
in need of further study. 
Fees and Stipends : 

Most physicians prefer to assuroeresponsibility for their own 
continuing education and are not adverse to tuition fees (37) (169) 
(204) (260). There is, however, less agreement with respect to receiv- 
ing financial remuneration for course attendance. In the California 
survey (37) , 39 percent of the respondents were somewhat in favour of 
stipends, 32 percent disapproved, and the rest were indifferent. 
Surgeons were least in favour of financial assistance, while general 
practitioners were most in favour. In New Jersey (99), while 40 per- 
cent disapproved of stipends, 11 percent approved, and 49 percent did 

^ not respond to the question ♦ 
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Scheduling of Programs ; 

Physicians are overwhelmingly in favour of concentrated short 
courses lasting one week or less (37) (99) (107) (233) (256) (260) (266). 
Most indicate that either week-end or evening programs would be rela- 
tively easy to attend, but express a preference for week-ends (6) (37) 
(169). In two surveys practitioners gave as their first choice, 
Wednesday or a Wednesday-Thursday combination (114) (233). With few 
exceptions, they prefer courses held in their local communities (20) 
(99) (117) (266) but distance is not as much of a problem as the phy- 
sicians' feeling of responsibility to his patients (185). Vollan (256) 
found that two-thirds of the physicians were willing to travel 100 miles 
or more, as long as the course was a relatively short one. 

Opinions differ with regards to the place of meeting • Many doctors 
prefer to leave the interruptions of practice and hence give first pre- 
ference to a university medical center (20) (192) (233), a local hotel 
(6) (192) , or resort areas where they can combine education with rec- 
reation (37) (192). Others would like programs brought to their local 
hospital (117) (200). 

Long term programs are not endorsed as uniformly as are short 
courses « There is some indication that physicians are becoming in- 
creasingly aware of the potential worth of lengthier in-hospital type 
training programs (6) (107) (192). In one study (37), three to six 
month clinical traineeships, and one to three week inservice programs 
were considered important by those who were familiar with them. Sim- 



ilarly, in a very recent survey of psychiatrists (169), 38 percent 
of the respondents favoured an extended intermittent course offered 
over a period of from one to nine months. 
Sponsors : 

Specialty societies represent an important source of con- 
tinuing education (42) (99) (117) (197), According to the California 
survey (37), courses sponsored by specialty societies were rated most 
highly by physicians, with those by medical schools rated second. 
Other agencies ranked considerably below these with local medical so- 
cieties rated last. Approximately 41 percent of the respondents 
indicated a iack of familiarity with courses co-sponsored by medical 
schools and hospitals, and 38 percent were not familiar with courses 
sponsored by hospitals alone. 

In contrast, a recent survey (200) co-sponsored by the Western 
Interstate Commission for Higher Education and the Mountain State 
Regional Medical Program (hereinafter refenrad to as the WICHE study) 
disclosed that in the mountain states, with the exception of Nevada, 
programs sponsored by local medical societies ranked first; hospital 
programs second; state medical societies third; and medical schools 
foiirth. Other studies also reveal (42) (263) that programs sponsored 
by medical societies and national organizations are rated higher than 
those sponsored by medical schools • While these differences are no 
doubt due in part to regional variation in the availability of pro- 
grams, Wenrich (263) suggests that it may also be related to the ''town- 
^Dwn" conflict. In his study, many respondents were of the opinion 
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that the physician teaching in a medical school had "lost touch with 
clinical reality." 
Instructional Processes ; 

Physicians seem to prefer the more familiar instructional pro- 
cesses. Lectures, panels, seminars, clinic demonstrations, educational 
films, symposia, and grand rounds, are generally familiar and approved 
by most (99) (114) (200) (233). Although the traditional lecture has 
been criticized as a didactic, passive technique in a number of studies, 
doctors rate it first in their list of preferred techniques (37, 177, 
169, 233, 239). Some physicians in Ruhe's survey (220) indicated that 
this was because "group discussions and question periods were often 
dominated by more vocal doctors who did not necessarily reflect the 
interests of the group." On the other hand, many physicians indicate 
that the exchange of ideas and information in informal conversations 
with peers can be an important reason for attending courses (212, 263). 
Two studies suggest that supervised clinical practice, which is rarely 
used at present, is gaining in popularity (37, 200), 

Physicians also express interest in the newer uses of the mass 
media such as television, radio, and recordings, but they tend to rate 
them lower than the personal contact methods (37, 117, 263). VThile 
this rating may be due in part to the fact that these media are not 
always available in all regions (39, 99, 200, 212) in California, where 
all three media are used extensively in continuing medical education, 
responses indicate that they are perceived by physicians as supplement- 
ary when measured against the total spectrum of avallabla methods and 
techniques (37). 
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According to a number of surveys, the least popular method of 
instruction is correspondence study (20, 37, 192). One study found 
that programmed instruction was well received (263) . 

In general, specialists indicate a preference for reading, 
teaching ward rounds, and other more clinically applied techniques 
(42, 117); however, there are considerable differences in the prefer- 
ences listed by those in the different specialties. General practi- 
tioners prefer methods more compatible with a busy practice. They 
rate the mass media and bedside clinical courses in medical schools 
relatively high, as opposed to reading and long term clinicaL trainee- 
ships (37). 

Younger physicians favour more participation (37, 117, 200). 
They are also better acquainted with the different teaching techniques 
and are more discriminative in evaluating their effectiveness. Thus 
in the California survey, while younger physicians tended to rate short 
courses higher than older physicians j, they were less likely to consider 
them applicable to all subject matter than were their elders. With the 
exception of audio-digest which was ranked fairly high, they considered 
the mass media less effective than did their older colleagues. 
Felt Learning Needs : 

Surveys disclose that physicians want subject matter wMch is 
immediately practical and applicable to their particular practice situ- 
ation (37, 84, 212). The most common criticism of non-psychiatrist 
physicians is that psychiatrist teachers do not understand their practical 
problems (34, 229, 258). Studies suggest that physicians atitending 



32 



postgraduate courses in pisieiiiatry want tD learn conxrrete ways to diagtmse 
and treat particular psittsitEs, and to increase their skills in communi- 
cation (36, 217, 229, 22E3-, 245)- In short, practitioners are more 
interested in common medical problems rather than esoteric diseases and 
unusual procedures (37) (190), but this does not mean that they would 
ignore new developments (126), In one study, 54 percent of the respond- 
ents felt that insufficient attention was given to recent innovations in 
medical techniques. This opinion was more prevalent among generalists 
and those in medical specialties than amongst surgeons (37). 

Physicians also want programs to deal with one or two topics in 
depths rather than a broad coverage of several subjects (107, 126, 192). 
Specialists are of this opinion more often than generalists, but even 
the latter prefer more intensive coverage of content (37). 

There is somv^ evidence that practitioners would like refresher 
courses in the basic sciences (37, 107), but there is no general agree- 
ment on this. In one study ^ome 90 perceaSr of the respondents felt that 
basic sciences and clinic a T ir^ earch programs should continue to be 
offered, but ro a lesser a^r:55e (107), In another study approximately 
69 percent of the respondeiaisis ^re in favsDur of more such courses, with 
specialists im medicine mmfci ifivourable ^dxile general practitioners 
were least inrerested (37). 

According to the Cafilfeimia report (37), the subject mattrer most 
frequently requested by phys^feLans relates to the diagnosis and treatment 
of disease. Moreover, physicians' interest pertaining to medical con- 
ditions is to a considerable extent specific tvO their area of special- 
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ization and place of practice (42, 229). Thus, in the Utah study (A2) 
It was found. that while endocrinopathies rated highest among all groups^ 
and cardiac arrythmias second, these were ranked very low by surgeons. 
Similarly, in one area where the socio-economic level of the polulation 
was higher, all physicians displayed a greater interest in psychiatric 
subjects than did those from less prosperous areas. When individual 
practices were examined, great variations occurred in the physicians' 
perceptions of their learning needs. 

At least two studies suggest that physicians would also like 
more courses dealing with medico-social problems, notably in the areas 
of "physician-patient relationships," and medico-legal problems (37, 67). 

The Utah (A2) and WICHE (200) studies indicated there was little 
correlation between a physician's expressed learning needs and those* 
conditions most frequently encountered in medical practice. Of all 
groups, generalists were found to be the most realistic in relating 
educational needs to practice problems. At the same time, ±t was ob- 
served that a great deal of the practitioner's time was spent in treating 
minor ailments which could have been delegated to medical assistants. 
Other Information Sources ; 

Harris reviewed the published research on the utilization of 
medical communication sources (111) and concluded that the majoriisy 
of doctors were acquiring their medical information through visits from 
the pharmaceutical representative, direct mail, drug sample literature, 
medical journals, consultation with colleagues, and professional meetings, 
rather than through formal courses. Subsequent studies suggest that 
Q there has been little change* Although the detail man is generally 
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perceived as less valuable (117, 263, 265), medical journals, iictsolicited 
literature, consultation with colleagues, and professional meetings, are 
utilized extensively by most physicians (117, 200, 263). At the same time, 
while physicians may use these information sources, they do not necessarily 
find them too useful (185) . 

Peterson eit al (185) noted that the most common criticism ex- 
pressed by general practitioners was that medical journals were^ too 
theoretical and the content net sufficiently relevant to medical practice. 
A more recent survey by Hamburg and Dohner (109) suggests that despite the 
passage of time, the opinions of generalists have not changed, with over 
50 percent of the respondents rat±ng current medical literature as of 
little use as a source of information in the field of urology. ]PFonethe- 
less, Peterson and his colleagues (.185) were able to show a posxtive 
correlation between the quality of a physician's practice and hdLs interest 
in seeking new knowledge through the purchase of medical journ^s* Sim- 
ilarly, Wenrich (263) in identifyiiag the characteristics of "gatekeepers" 
or educational influentials in one small community horspital., fiannd that 
such physicians relied much more okx written sources, informajL consult- 
atiooos., and discussion with related^ health professionals in t3»e hospital 
than did those physicians who sought their advice* 

Although research on the use of informal sources of continuing 
learning is both limited and limiting (150, 275), Peterson et al (185) 
conclude, as have many others subsequently > "that basic medical education 
has been only partially successful in inculcating in future practi- 
tioners both the ability and the desire to seek out through a variety of 
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informal sources, greater knowledge and underscandiug of medicine through- 
out their professional lives." 
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CHAPTER III 



ORGANIZATION AND ADMINISTRATION 

The recognition of the necessity fair arxd importance of confltimairng 
education has grown steadily in recent years.. The growth in Inteirest and 
paxuxcipatlon ±s reflected in the increased mimber of .courses reporJijad as 
'toU as the involvement of more and more insxinutions and organizaislons 
in the sponsorship of •educational activities for medical practltl auter s- 
JOanjg with the growth in opportunities and participation has crnme •fdert-' 
oEfiable txends in the organizat3.on and. ;adm±BiEiiS:tration of cimX - lnmin g^ 
^ucation programs. 

ORGANIZATION 

A.'varieliy of patterns of organization. ^aare encountered ±n aas3tr- 
tiiuiEtng education for medicine. These pat ter ns; are determined tro some 
^extent by the sponsorship of the program. 
Jfemftaer of Courses and Sponsors : 

The number of courses available to physicians has been increas- 
iTSffi (over the past decade, with an average increment of approximately five 
percent per year from 1961 to 1970. In 1970r-1971 there was an even 
greater increment of fifteen percent over the preceding year and this 
was accompanied by an equally sharp increase in the total number of 
institutions presenting courses. 
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In 1968-1969, 372 institutions sponsored or co-sponsored courses 
and this increased to 611 institutions in 1970-1971 (54) • These included 
77 medical schools, 291 non-school or community hospitals, 50 city, county, 
and state medical societies, 66 specialty medical societies, 33 voluntary 
health agencies, and 94 "others," including schools of public health, 
postgraduate medical schools, private clinics, foundations, or local 
and national governmental agencies (61) . 

The major producers of courses have been the medical schools and 
community hospitals. As noted in Table II, medical schools alone produced 
over one half of all courses offered from 1961 to 1969 • Although this 
decreased to 44 percent in 1969-70 and to 35 percent in 1970-71, medical 
school programs are still the most extensive in that the number of 
courses offered per school is far greater than the number of courses • 
offered by other sponsoring agencies* Medical schools are reported to 
average approximately twelve to thirteen courses per school per year, 
coiapared with community hospitals which average roughly two courses per 
hospital per year (61) . 
Course Content and Eligibility : 

For the past seven years the greatest number of courses have 
emphasized internal medicine^ psychiatry, and general medicine, in that 
order (52) (54) (59) (61). Other major fields with a substantial number 
include surgery, pathology, opthalmology , pediatrics, obstetrics, and 
gynaecology (59). Despite this specialty orientation, over one half of 
the courses listed during the past five years have been open to both 
generallst and specialist. Because of the varying backgrounds and differing 
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learning needs of the two groups, one might question the wisdom of this, 
however, Ruhe (220) notes that the experience of medical schools discounts 
this concern as medical school courses are more often designed for a 
general audience. An exception to this is psychiatry where there is a 
tendency to provide different levels of instruction suited-'to the needs 
of non-psychiatrists (88) (231). At the University of Southern California, 
practitioners are offered three course levels: a basic, an intermediate, 
and an advanced course (88) . 

While it is impossible to determine the extent to which programs 
are designed for interprofessional education, the general impression is 
that the number is small (198) . One program which appears suitable to 
an interdisciplinary approach is the "Care of the Premature Infant" 
which originated at Cornell Medical Center in 1949 (19). This program 
was designed for teams of physicians and nurses and the program model 
has been used in a number of centers in both Canada and the United States 
(19) (115). More recently, several Regional Medical Programs have re-- 
ported successful multiprof essional programs on the "Management and 
Rehabilitation of the Stroke Patient." In most of these, physicians, 
nurses and physical therapists provide the team nucleus with involve- 
ment of occupational therapists, rehabilitation counsellors, and other 
essential health workers where these are available and required (252) . 
Other fields of study reporting occasional interprofessional efforts 
are psychiatry (20), and public health (182). 
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Patterns of Course Organization ; 

In the annual listing of courses reported in the A.M. A. Journal, 
there are six major patterns of course organization : 

1. Continuous courses are conducted over a consecutive number 
of hours, days, or weeks, but usually of short duration. 

2. Intermittent courses extend over a period of time with a 
certain number of hours per week or month during that time* 

3. Circuit courses are presented in rural areas by travelling 
faculty. 

4. Traineeships are clinically oriented in-hospital residency 
type programs ranging in length from five days to one year. 

^* Home study involves correspondence, programmed instruction, 
tape recordings and similar devices that enable the physician 
to study in his own time. 

6. TV-Radio courses are similar to continuous courses but offered 
through the media of radio or television to physicians at 
home . 

Of these six types, continuous courses appear to be the most 
common pattern as well as the most popular. In the four years reported 
in Table III these accounted for some 62.14 percent of all courses in 
1964-65 with a high of 66.79 percent reached in 1966-67. During 1969-70 
the 1261 continuous courses accounted for 65.54 percent of all courses 
offered with 83.74 percent lasting one week or less. 

Intermittent courses were the next more ^Tiequent pattern with a 
high of 31.42 percent of all courses in 1964-65 but showing a decline to 
26.86 percent in 1966-67 and a^recovery to 30.95 percent In 1969-70. 
In that year these courses averaged 31 1/2 hours of instruction and 
appear to have the potential for f>roviding more continuing instruction. 
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Psychiatry makes the greatest use of intermittent scheduling 
because it is felt that instruction extended over a longer period of 
time is essential in changing attitudes and teaching psychiatric con- 
cepts. Currently, over 70 percent of all psychiatric courses are offered 
intermittently^ and of these, a few extend throughout the whole of an 
academic year (59). This may account in part for the poor over-all 
attendance (217) (229) (245) since, as previously noted, busy practi- 
tioners find it inconvenient to travel long distances for a few hours 
of instruction. 

Postgraduate Traineeships are offered by many hospitals without 
publicity, hence the number recorded In the Annual Course Listings may 
not be an accurate reflection of what is currently being offered. Of the 
77 listed for 1969-1970, all were offered on a full time basis ranging in 
length from five days to one year. While 16 sponsors provided specific 
course dates, the remaining 61 sponsors left the scheduling to "be 
arranged" implying that enrollment was negotiable anytime throughout 
the academic year. In all but three cases, planned instruction was used ' 
in addition to clinical experience. Of the 68 sponsors specifying, only 
10 limited enrollment to either specialist or generalist and the remainder 
were open to both groups. Fees varied from no fee, to $2,350 for one 
eight month experience in pediatrics. Over 80 percent of the sponsors 
were medical schools, with the Universities of Kansas and Maryland 
offering the greatest number and variety of programs. 

In both Canada and the United States, physician interest in 
this type of program is said to be increasing, and a number of medical 
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schools report plans to expand their present offerings (8) (10) (35)* 
Major deterrents to date have been the lack of university facilities; 
the chronic shortage of physicians-; and the loss of physician Income 
(189). A program of physician and housestaff exchange fashioned after 
the successful Tufts regional program has been cuggested as one pos- 
sible solution to these problems (23) (AA) (A7) (61). Another sugges- 
tion is Dimond's hj.ghly ambitious proposal calling for the establishment 
of a National Graduate Medical Center using one or more of the Veteran's 
Administration Hospitals. In this plan, practising physicians would be 
offered funded training positions at the Center for periods of one to 
twelve months. A permanent staff of proven teachers would be assigned 
to the Center and, in addition, outstanding practitioners would be 
invited as visiting clinicians (7A). 

At the operational level, a plan which has been implemented 
with relative success at Dalhousie University in Halifax (67), Staunton 
Clinic in Pittsburgh (186), and more recently, by the Washington/ 
Alaska Regional Medical Program (71), is a traineeshlp offered on a 
part-time basis but extending over a fairly long period of time. The 
Washington/Alaska Regional Medical Program has organized a postgraduate 
pireceptorship network involving sixteen university and community hos- 
pitals. 

During 1970-71, the Faculty of Medicine at the University cf 
British Columbia offered 21 different types of "Clinical Traineeships" 
in which 56 physicians participated and received 10,A75 hours of 
instruction at an average of 187 hours to each person. The University 



45 



also has a "Clinical Clerkship Elective Program" for final year students 
through which they serve for 12 weeks at one of 29 community hospitals 
in British Columbia. Participating physicians in local community hos- 
pitals indicated that the students had an influence on their own con- 
tinuing education study habits* 

Circuit courses have shown a steady decline during the four years 
reported. Probably the most successful circuit program is that operated 
by the University of Kansas. For the past seven years, this program 
has offered six symposia in each ot eight circuit centers distributed 
throughout the state of Kansas bringing continuing education to approx- 
imately 500 to 600 rural physicians annually (267) . Another successful 
model is that operated in Michigan. Towsley (6) reports that in the 
year 1967-1968 programs were offered twice yearly in twenty areas with 
1,033 physicians attending at least one of the two programs and 637 
attending both. In Canada, the successful pioneer has been Dalhousie 
University which presently operates regional programs involving 34 
centers, each of which received five or six visits per year from the 
Dalhousie faculty (15) . 

An e.ctension of this circuit concept to include community hos-- 
pit als (non- teaching hospitals, both rural and urban) as learning centers 
with ongoing informal and formal programs of continuing education, is 
what is receiving the greatest emphasis in the literature of postgraduate 
medical education today (85) (104) (215) (246). The implementation of 
Public Law 89-239, authorizing funds for continuing education developed 
co-operatively by medical schools and health agencies within the frame*-* 
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work of Regional Medical Programs (hereinafter referred to as (RMP) \; 
on heart, stroke, cancer, and related diseases, is reported to have 
been a major factor facilitating this trend in the United States 
(252). Presently, there are 55 RMP distributed throughout the nation, 
and some of them provide substantial evidence of the wisdom of develop- 
ing continuing education as an integral part of health services. 

Radio , t elevision , and home study programs are few in number and 
have shown only slight varlatior. over the years. 

Another type of extramural program which deserves brief mention is 
the postgraduate cruise. As noted earlier, physicians indicate a pre- 
ference for a program which combines a vacation with a limited amount of 
study. For a number of years Albany College (277), the University of 
Florida (267) , and the Academies of General Practice (125) have sponsored 
such cruise programs, but the high cost and the time factor are said to 
limit their use (256). 

SPONSORSHIP: ROLES AND RESPONSIBILITIES 

While one of the strengths of continuing medical education lies 

in the diversity of agencies active in the field, at the same time the 

need for co-ordination and co-operative planning has become accentuated 

by the great proliferation of programs. In 1955 Vollan (256) concluded: 

There are over 300 different Institutions and organizations 
in the United States known to be engaged In postgraduate 
medical education in one way or another. This diversity of 
sponsorship results in duplication of efforts as to the conr^ 
tent, faculty, facilities, and scheduling of courses- vlthin 
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given areas. The net effect is inefficient utilization of 
teaching resources and frustration on the part of the phy- 
sician who has to choose from among a large selection of 
competing offerings. Although competition in itself is not 
harmful, in this case it results in wasted time, effort, and 
money . 

In the inteirvGning years, the number of sponsors has increased 
two-fold, and studies both on a national and regional basis merely 
reiterate the conclusion of the Vollan report (64) (114) (219) (230) » 
In 1952, the Massachusetts Medical Society met this problem of dupli- 
cation and maldistribution of courses by establishing the Postgraduate 
Medical Institute, which serves as a central clearinghouse and single 
source of information pertinent to all continuing medical education in 
Massachusetts and the other New England states (248) . The California 
Medical Association established a similar statewide information service 
in 1964 which includes data projected three to five years on all 
California and Hawaii educational activities and as a further aid to 
planning courses, the association now publishes in its journal an annual 
summary of continuing education for the State of California (64) . 

With the exception of these, and a few successful co-sponsorship 
plans whereby medical schools, medical societies, and public health 
departments have joined forces to plan and co-ordinate continuing ed- 
ucation for an entire state (207) (252) or region (6) (178) (252), .the 
problem of co-ordination remains unsolved. Related to this problem 
and contributing to it, is that of defining respective roles and respon- 
sibilities. The history of continuing medical education is replete 
with illustrations of how the major responsibility for continuing ed- 
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ucation has shifted back and forth between medical societies and medical 
schools (45) (256) and, more recently, community hospitals and RMP 
have become involved also (6) • 
Medical Schools : 

As noted earlier, medical schools have been responsible for 
over one half of the courses offered to practicing physicians over the 
past decade. While the number of schools involved has varied, the over- 
all trend has been toward increased piarticipation (54) (59) (61) . 
Research data suggest that this involvement through continuing educa- 
tion programs does not necessarily indicate that the medical schools 
have made a major commitment to continuing medical education. In 1952, 
Norwood's survey (174) of eighteen medical schools revealed that while 
most of ihem regarded state and local medical societies as appropriately 
cast in the supporting role for educational activities administered 
by the medical schools, their own interest in continuing medical ed- 
ucation was only casual. The majority of educators and administrators 
interviewed tended to favour the undergraduate and graduate programs, 
and to regard continuing education as an "extra chore." In 1963, 
Ruhr's study (220) of eighty-six American and twelve Canadian medical 
schools, disclosed that only twenty-five schools had programs rated 
"good" hy the criteria outlined by the Council on Medical Education. 
The majority of program offerings consisted of isolated courses unre- 
lated to one another and frequently lacking in specific objectives. 
Of the American schools, thirty-seven C43%) rated continuing medical . 
education as a major responsibility, while four (33%) of the Canadian 
schools did so. 
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Many faculties have a sense of obligation to contribute to 
continuing education. • .But in the face of shortage of funds 
and personnel and overwhelming teaching and research commit- 
ments, there is an equally strong feeling of frustration that 
to take on more would be impossible. The fault is not that 
a great deal can^t be done... it is being done. The models 
exist but an example here and there is not adequate to demon- 
strate the fact that physicians must have easy access to 
current information that can be used for the benefit of their 
patients. In future, I believe it is inevitable that univer- 
sities and their medical schools will assume a major share of 
responsibility in th^ field of continuing medical education. 
A major share is not the whole of responsibility. I hope that 
the periphery may co-operate with the center by trading ideas 
and personnel in such a way that the tencher learns and the 
students teaches, and that there will be an exchange of fact 
and knowledge for wisdom and experience. 

Community Hospitals and RMP; 

Since community hospitals are widespread and utilized by most 

physicians as part of daily practice, considerable attention is now 

being directed toward their development as the major foci of continuing 

medic^il education (216) (269) . It has been emphasized that if the 

regular hospital staff conferences, committee reviews, consultations, 

and other routine day to day activities were effectively organized, 

these could serve as the means through which continuing education 

could become a built-in component of medical practice (188) . Even 

more importantly, there is a growing consensus that the hospital setting 

is the one place wher<a the quality of medical care could be assessed if 

an ongoing program of current case medical audit were enforced (85) 

(139) (225), 

On the other hand^ physicians in practice may not share these 
views. Werch's study (264) of five community hospitals revealed that 



while all five utili^sed regiilar chart reviews, the prime objective was 



51 



only to meet the minlxnuzn standards of hospital accreditation. In many 
Instances, there was a general "hands off" pol\cy, and even gross errors 
were overlooked and not criticized constructively. This study also 
disclosed that consultations were more often used simply as a way to 
transfer patients to another physician or service, and rarely was 
there an exchange of medical viewpoints. Similarly^ Yqk and Robertson's 
review (103) of eighty ^^ilx Consult.-nt 's Letters found that only 30 
percent of the reports included relevant new information or reinforced 
existing information which might have been of educational value to the 
rief erring physicians. Moreover, in not one case was a reference cited. 

Wenrich's study (263) in one community hospital disclosed that 
since hospital by-laws required active physicians to participate on 
review committees, and made attendance at hospital staff conferences* 
compulsory, "whatever their educational value, they were viewed by 
physicians as administrative obstructions, designed to police the 
practice of medicine." Wenrich quotes Dr. N. Steam as saying, "ied- 
ucational activities at the local level can be successful only if indi- 
vidual physicians see themselves not only as physicians but also as 
teachers, and are willing to assume some responsibility for preparation, 
partlcipat^i'Dn, arid presentation." 

The phenomenal growth of separate hospital departments of medical 
education in recent years is viewed by many authors as a significant 
development which will facilitate this trend (104) , As a relatively 
new educational activity, the role and function of these administrative 
units is not clearly defined and in many instances, medical 

O 



52 



education directors devote only a few hours a week to continuing medical 
education (25) (188). Moreover, the response of individual hospitals to 
this new and more demanding role is variable with some even resisting 
attempts by medical schools to aas^ist: thfi hJi:^pltals ±fA developing their 
own ongoliig programs of continuing medical education (14) (188) . 

The 1967 Planning and Goals Conference sponsored by the California 
Medical Association (188) recommended: 

1. That community hospital «<*BSifcatl staffs B?e encouraged to 
organize a committee to s^DiEtdLy tSie problems of continuing 
education. This should vaot be confused with the regular 
program committee. 

2. That the CMA should communicate with hospitals to infocm 
them of educational assistance that is aiwil^bll^. For 
example, some hospital staff 4'0 *aot knossir thait some medical 
schools will heSip thetm with gxianning hospital staff meetings. 

3. That the CMA encourage community hospital medical staffs' 
and medical schools to enter into experimental projects 
designed to discover feasible relationships that might be 
developed. 

Recent reports by the Council on Education of the American 
Medical Association (59) (61) that frane ^icx^^mBs has been made 

in these directions. As previously mentioned, EMP have in many in- 
stances served as a stimulus in encouraging community hospitals to 
assume a more significant role, and in turn to seek assistance from 
the medical schools. Some RMP are themselves now being charged with 
developing "parallel offerings not necessarily complementary to those 
of universities and component societies" (6) . 
Medical and Specialty Societies ; 

Historically, local and state medical societies were the pioneers 
of postgraduate courses for physicians (191) . Although still active in 
the field, their programs have been declining steadily. According to 
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the Council's Annual Reports (54) (59) (61) general medical societies are 
presently averaging one percent or less of the total postgraduate hours 
of instruction reported* At the same time, national > state^ and local 
meetings with an educational component are reported on the increase, 
but the general consensus is that most medical society programs lack 
co-ordination snd continuity, amd tJhat the business and social functions 
frequently take precedence over educational activities (256) (263) . 

Although many medical societies are presently re-assessing and 
attempting to improve their current programs, others are questioning 
their role as prodiicers of continuing education (6). At 4 recent dis- 
cussion this view was advanced (268): 

Leadership as a learned society is passing from medical society 
to hospital staff, I do not hold that this is good or bad, 
simply that it is happening. Local groups that are highly 
organized are perhaps better able to car^cy out programs of con- 
tinuing education than medical societies which may have many 
eyttBooneaat bodies concerning themselves with education, thus 
^ffiwing confusing re-duplications. The role of the medical 
Hdciety is really the co-ordination of this kind of activity, 
the development of a multi-phasic approach, including medical 
colleges . 

An application of this is illustrated by the activities of the 
California Medical Association. In addition to co-ordinating course 
offerings and accrediting programs for the State of California (187) , 
the Association is conducting Regiot^al Medical Institutes in cooperation 
with several of the state's medical schools* To further assist the 
medical staffs of community hospitals in developing effective continuing 
education programs, the Association recently published a supplement to 
the American Medical Association's Guide (38), and is operating a pilot 
project to examine the potential role of the community hospital* 
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In contrast to general medical societies, specialty societies 
are well established as purveyors of continuing education. For the 
past several years they have averaged from eleven to twenty percent of 
the toti^l hours of Instruction reported (52) (61) . While their offer- 
ings are few in number in comparison with medical schools, the number 
of physicians attending specialty courses almost equals the attendance 
reported at medical school programs. Thus for the year 1968-1969 (5A), 
specialty medical societies and Academies of General Practice offered 
collectively A67 courses which were attended by 29,590 physicians at 
an average of 63.36 per course. In contrast, medical schools offered 
1,128 courses with an attendance of 34,106, at an average of 30.24 
per course. 

De^^pite this seemingly successful performance, specialty medical 

societies are presently receiving the same criticism that is directed 

at medical school and general medical society programs. In short, 

it is said that their programs are episodic, and that the relevance 

of "one set of presentations to others, either within the meetings 

themselves or relative to other meetings, often is strikingly lacking" 

(230). Miller (159) adds still another dimension to the problem: 

The incredible success of modern preventive and therapeutic 
measures in medicine is changing the basic nature of medical 
practice. The growing host of aging patients, of those with 
chronic debility or disease, calls for a kind of care that is 
less readily measured by precise Instruments or in precise 
units. The "Recent Advances..." in dealing with these problems 
are as often provided by behavioral scientists are by those from 
the purely biologic disciplines; the subtleties dnd complexities 
of patient care in this context are only beginning to be elab- 
orated by serious students and have yet had little impact upon 
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practitioners or the educational programs offered to them. 
It will require the most skillful leadership to introduce 
such important components of the contemporary social fabric 
into the Instruction of physicians whose focus has for so 
long been the disposition of acute problems**. 

PROGRAM PLANNING AND ADMINISTRATION 

The literature pertaining to program planning and administration 
is limited to medical schools , consequently, this section is confined 
to arrangements within schools, of medicine. 
Administrative Arrangements : 

In all articles on the organization of continuing education in 
schools of medicine it is recommended that there should be a clearly 
defined department or division with a full time director responsible 
for the overall program (38) (207). This ideal has been achieved in but 
a few medical schools 

In 1963, Ruhe (220) found that while 54 American (62.8%) and 
6 Canadian schools (50%) reported having a department, section, division, 
or standing committee for the planning and implementation of continuing 
education, only 5 American (5.8%) and 1 Canadian school (8.3%) had a 
formally recognized department identified in the Directory of the 
Association of American Medical Colleges. Moreover, while 57 American 
(66.3%) and 7 Canadian (58.3%) schools reported a part-time person 
responsible for continuing education, in only 3 American (3.4%) and in 
no Canadian schools was there a full--time director or head. As late as 
1967, Sullivan (240) noted that o£ the 65 medical schools offering courses 
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in the Annual Listing, 20 percent had a listed department or division 
of continuing medical education. 

Reporting on the current accreditation program in the United 
States, Ruhe (218) identified the lack of central authority as one of 
the major problems facing the accreditation committee. It has been found 
that in many institutions programs are developing within schools or hos- 
pitals with little co-operation among departments. Even where there is 
central authority, in some institutions the responsibility for the 
development of educational programs is left to individuals or groups 
rather than planned on a departmental basis. As a result, educational 
offerings are said to range from excellent to poor. 

In Canada, a 1968 survey (241) of medical schools disclosed that 
twelve of the fourteen responding schools had an established department, 
division, section, or standing committee on continuing education. The 
remaining schools reported persons assuming this responsibility on a 
part-time basis , ranging from one quarter to three quarter time. On 
the Other hand, all fourteen responding universities indicated that the 
postgraduate division or section assumed major responsibility for the 
selection and arranging of course content under the direction of an 
appointed chairman. 
Instructors ; 

Courses sponsored by medical schools are taught largely by mem- 
bers of the regular faculty or by guest lecturers from other medical 
centers. Non-academic physicians or non-medical personnel are utilized 
far less frequently (45) (220) (241). A view gaining strength is that 
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practising physicians should be encouraged to participate in teaching, 
thereby involving them in their own continuing education and at the 
same time alleviating some of the excessive demands made on the medical 
school faculty. The evolving role of the teacher as consultant in 
regional programs (208) probably illustrates best the successful imple- 
mentation of this approach. The pilot project reported by the Tufts 
New England Medical Center (210) utilizes residents as teaching consult- 
ants in several of the small community hospitals in Maine which is 
another innovative and promising program model* 

Despite the trend toward greater utilization of clinicians as 
teachers, with the exception of psychiatry teacher training programs 
are still sparse. In psychiatry, short training courses for program 
directors and teachers have been undertaken by a variety of groups • 
including: WXCHE; the American Psychiatric Association; The National 
Institute of Mental Health's Continuing Education Branch; The American 
Academy of General Practice; and others. In a recent editorial, Stratos 
(238) reports that the Psychiatry and Medical Practice Committee and 
the Physician Education Project of the American Psychiatric Association 
plan to expand consultation services and intensive teacher training 
sessions for ttose involved in teaching psychiatry to non-psychiatrists. 
From the general field, a recent proposal by McMaster University plans 
to provide a visiting teacher program in which both practitioners and 
consultant from the region will work in the McMaster clininal teaching- 
units to update their clinical skills (11) • 
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Although there is a growing interest in the need to improve the 
quality of instruction in the undergraduate medical training program, 
this has not extended generally into continuing education. The feeling 
that proficiency in medicine is the principal prerequisite still per- 
sists without regard to teaching ability or t^ the amount of learning 
achieved by participants. Some moves are underway to improve the quality 
of instruction by providing clinicians with trainxng for the instructional 
role* 
Finances : 

Financial support for continuing education varies widely from 
school to school (220). In general, the major sources of revenue are 
tuition feeSy some government health grants, and donations (8) (lA) 
(135) (27A). The percentage of the medical school budget devoted to 
continuing education is almost negligible. Nevertheless, since most 
schools do provide facilities as well as faculty time, their contribution 
is not insignificant (45), 

Some medical schools attached to state universities receive 
additional funds from the legislature and state health departments. 
Others support their programs through contracts with community hos- 
pitals , some are financed by fees charged for individual programs, or 
consultation services to other institutions (9); still other programs 
are managing to break even or to operate at a modest profit almost 
solely on tuition and the contributed services of the regular faculty 
(9) (45) (55). Professional associations, voluntary health agencies, 
federal training grants^ pharmaceutical firms, and philanthropic soci- 
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eties all contribute significantly to continuing education in medicine 
(8) (12) (45) (55) (207), 

More recently, particularly in the United States, the Inderal 
government has provided greater financial assistance to continuing 
medical education. Childs (44) noted that projects supported by govern- 
ment have proven effective in accelerating the development of more 
innovative programs of continuing medical education. 
Publicity and Promotion ; 

In the United States, sponsoring institutions may publicize their 
course offerings through the "Annual Course Listing" published each year 
in the early August issue 6f trhe Journal of the American Medical Associ- 
ation . In addition, medical jouxmals in both Canada and the United 
States publicize selected course offerings. Other traditional methods 
of advertising programs include posters, direct mail and personal 
announcements (241) . 

A number of state medical societies (6) (64) report the use of 
a special continuing medical education bulletin. One such, which is 
mailed to physicians and hospitals in the New England States , announces 
all formal programs offered in New England including essential infor- 
mation as to their time, place > and tuition (248). 

In Canada, the University of British Coliimbia (8) publishes an 
annual listing of courses offered by the Division of Continuing Education 
in the Health Sciences. This is mailed to all physicians in the province 
to assist practitioners in planning their personal programs .of continuing 
education well in advance. 
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Because these publications are often overlooked by physicians, 
some course sponsors are using reinforcement through personal visits to 
physicians (222) (269) and newspaper, television, or radio announcements 
(11) (269). 
Programming 

In spite of all these efforts to promote continuing medical 
education, the problem of relevance is thought to limit the effect- 
iveness of most programs offered (84) (173). Those expressing this 
view suggest that programs ignore the iiiterests and expressed needs of 
practising physicians. Reports from medical schools suggest that many 
use questionnaires extensively to test the market for continuing ed- 
ucation (220) (241). Indeed, as early as 1952, Norwood (174) found 
that it was a common practice for medical schools to send out request 
forms on which physicians could note their suggestions for courses. 

Many programs are not designed with clearly defined objectives 
and, as Miller (159) indicates, in the process of implementation phy- 
sicians' "wants" may become confused with or subordinate to what the 
programmers "want or think the practitioners need/* Moreover, "unless 
the teacher is careful to determine where his students are in their 
learning. and requires them to exhibit some understanding of each 
step before proceeding on to the next, a program of greatest relevance 
may end as a collection of nonsense syllables with carefully concealed 
irritation and disappointment on both sides." 

Sodeman (230) has stressed that the ideal program is "an 
individual one built to suit the specific requirements of each physician. 
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and perhaps a few more like him," The obvious Implication of this 
principle is that the programs most likely to succeed are those which 
involve the learner in the planning px^ocess. That present organiza- 
tional structures and administrative patterns are unable to meet this 
required is implied in the many critiques on continuing medical ed- 
ucation (104) (219) (225) (246). 

Several recent experimental programs have attempted to involve 
the consumer in planning programs. MacLeod (144) reports a successful 
self-sponsored and self-administered course on internal medicine at. the 
Yale-New Haven Medical Center. Although initiated as an annual review 
for internists preparing for board examinations, this program has 
evolved over the years into an ongoing comprehensive review of the 
whole field. While the main criterion of "success" has been measured 
largely in terms of increased enrollment (from 26 to 60 physicians over 
four years), in the words of MacLeod: 

The growth of this highly structured yet informal review course 
appears to have been a function of the relevancy of the course 
material and a sensitivity to the changing needs of the group. 
The principles of student participation in planning and admini- 
stration. and continuous feedback through questionnaires, served 
as the basic framework for the organization of the course. 
These principles are important considerations for others desiring 
to set up such a course and merit emphasis by the American 
Medical Association's Council on Medical Education in setting 
standards for accreditation of Institutions providing postgraduate 
courses. 

Another experimental project which points out the need to con-- 
aider alternative administrative arrangements for programming, is that 
reported by Torrens (246) of St. Luke's Hospital In New York City. In 
j/^Ls project > a specially created hospital department called The Community 
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Physician Relations Office was established in order to assist non- 
affiliated general practitioners with patient referral problems and con- 
currently to offer continuing education programs specifically designed 
to meet the day to day problems encountered by physicians in their local 
practice. Initiated to offset the Increasing isolation of general 
practitioners from the specialist oriented teaching and research hos- 
pitals, this program has resulted in increased utilization of the 
hospital's referral services as well as the teaching conferences and 
grand rounds which previously the general practitioners had ignored 
as "of little i?*=<^ to them in their practices." Torrens recommends 
that "other teaching hospitals establish a similar office or department 
to serve as a single place to which the community physician knows he can 
turn for assistance with problems of patients in his practice 3 and 
from which he can obtain information about patients he has referred 
to the teaching hospital for care*" 

Webster and Ozarin (262) describe a program in North Carolina 
in which a circuit riding psychiatrist made regular visits to all phy- 
sicians in five counties and was available at any time physicians 
wished to consult him about cases. During the first two years in which 
this project was in operation, the number of admissions to the state, 
mental hospital from this five county area decreased whereas admissions 
from other counties increased. The program is 'being expanded throughout 
the state as an adjunct to community mental health services. 

The preceptorship project sponsored by the Washington/Alaska RMP 
■*« another example of a program specifically designed to meet the learning 
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needs of individual physicians • The physician requesting a preceptor- 
ship is asked to outline what he wishes to learn and to ind .cate whether 
he wishes a structured program or one with free study and conferences. 
The planner uses this information to design an individualized program 
of studies for the physician. The evaluation of the program is based 
on the objectives stated originally by the physician To date, 92 
percent of the physicians who have participated in the program are 
reported to have satisfied at least three-fourths of their educational 
objectives. Although no statistical evidence was offered to show im- 
proved patient care as a result of the program, Davidson et^ al^ (71) 
noted that "In this type of program, the physician is able to satisfy 
his own educational needs which makes his experience relevant to his 
practice." 

Under the auspices of the Oregon RMP, Meighan and Burg (152) 
are investigating the effectiveness of an experimental project in which 
health professionals in two Oregon communities are given an opportunity 
to develop their own educational programs on the care of the stroke 
patient. This is based on Miller's "process" model which assumes 
that before adults learn they must recognize their need to know, and that 
this Is best accomplished by ±i:ivolving them in identifying problems and 
seeking solutions. To implement this, "stroke study groups" were 
formed, membership of which was interdisciplinary representing all 
health care professionals available in the communities. The study 
group task was to "identify existing barriers to the delivery of optimal 
^♦-^oke care and then to design educational programs to surmount them... 
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The project staff participated as facilitators enabling the groups 
to work together in identifying local educational needs or in planning 
programs..." To date, two groups have planned community programs 
which differ widely in objectives and approaches. One of these groups has 
submitted a proposal for a grant to continue the program independently 
when the experimental project ends. Meighan and Burg question "whether 
such a group can function without administrative assistance from outside 
the community..." 

CURRENT AND RECURRING ISSUES AND TRENDS , 

Despite the many unresolved Issues and operational problems, 
continuing medical education is thriving. Concurrently i a number of • 
developments are occurring which can be expected to influence future 
trends but there is still many issues that require the attention of the 
profession. 

Accreditation; ^ 

Since the publication of the original "Guide" in 1957, the 
American Medical Association has been working on a voluntary system to 
accredit Institutions sponsoring programs of continuing education. 
In 1961 > its Council on Medical Education appointed an advisory committee, 
and under its direction a number of site surveys were conducted to deter- 
mine the feasibility of such a plan (219). As a result of the study, 
an acceptable program of accreditation was proposed "and approved by 
. the Association's House of Delegates. In 1967, fomal accreditation 
ERXC^® initiated (81). By September 1970, 86 institutions and/or organi- 
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zatlons had been accredited and listed as such in the Annual Course 
Listing^. Ultimately, only accredited courses will be included in this 
Annual List. In this way it is hoped that programs of inferior quality 
will either be improved to meet accreditation standards or discontinued 
because physicians do not attend them (61). 

The "Guide" provides the criteria used by the survey teamsf 
responslbi^e f or v.accrediting programs (65). The California Medical 
Association has adopted this "Guide" as the statement of basic prin- 
ciples for its proposed accreditation of programs (187). Briefly 3tated^ 
these criteria are: 

1. There should be ADMINISTRATION of the t.o;T^ • ^tiring education 
program by a responsible person haviT?g t'^.e respect and 
support of the professional staff of thi. organization or 
institution. 

. 2* The BUDGET should be adequate to. the educational program 

undertaken to its continuing improvement. Sole dependenc<i 
on tuition fees tends to restrict unduly the quality of 
continuing education programs. 



3. The TEACHING STAFF should consist of physicians and their 
associates of proven ability » training, and experience. 

4. The CURRICULUM of any continuing medical education program 
should be designed to explore with considerable depth one 
subject or a closely related group of subjects. The ed- 
ucational merit of devoting sufficient consecutive sessions 
to explore more than superficially the background and 
advances in one subject is emphasized. 

5. There should be available FACILITIES that encourage par- 
ticipative methods of education, 

6. The EDUCATIONAL METHODS should include more than a series 
of lectures or panel discussions in which the physicians 
are primarily passive recipients ^ Emphasis on problem- 
solving is likely to increase student involvement. 
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7. METHODS OF EVALUATION of the ef f ectlvenerss of continuing 
medical education programs should be developed and used 
as part of each program. 

8. Each PHYSICIAN'S REWARD for participation in continuing 
medical education always should be his improved ability 
to care for his patients and the stimulation of his own 
spirit of intellectual adventure. 

While it is too early to predict the long term effects on this 

accreditation program, it is generally viewed as a noti -restrictive 

regulatory mechanism which will ultimately provide some direction for 

the development of the field (61) . 

National Plans : 

Darley and Cain (70) proposed in 1961 the establishment of a 
National Academy which would centralize the nation's education resources 
for continuing medical education thereby helping to co-ordinate and 
further its development. Subsequent to this, the major national medical 
associations formed a Joint Study Committee to consider the development 
of such an Academy. The Committee's report, written by Dryer (79) pro- 
posed the creation of an Academy which would be a "university without 
walls." Under this plan, a national agency would develop a core cur-- 
riculum "responsive to the needs of the nation's physicians." Using mass 
communication media, these ongoing comprehensive programs would be 
focused nationally, regionally, and locally, and physicians would be 
able to choose those programs which would best meet their individual 
needs. Among its many far sighted recommendations, the report emphasized 
that... "a partnership of our major medical resources will give strength 
to all which none possess separately, and that such an efficient balance 
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can be organized to articulate and reinforce national, regional, state, 
and local plans . " 

Following the publication of this report, the American Medical 
Association undertook to pursue such a plan and under the leadership 
of Storey (237), an intensive study of physician's needs was begun in a 
pilot project in Utah. In 1966, this project was discontinued because 
it was felt that local and regional conditions were not ready for such 
a large scale undertaking. 

The many highly imaginative and creative ideas Inherent in these 
reports are germane. The Interuniversity Communications Council founded 
in 1965 by Darley and a small interdisciplinary group of university 
people was a product of the original plan for the establishment of a 
National Academy. Similarly, Dimond 's proposal for the creation of a 
National Graduate Medical Center would have this Center serve as the bas 
for Dryer's "university without walls" jC73). The most recent proposal 
was that outlined by Bloom (6) and called the AMA Plan. In summary it 
notes: 

1. Among all forces involved, the American Medical Association 
would be the appropriate leader in continuing education, 
implementing an intimate partnership with universities or 
medical schools and Regional Medical Programs. 

2. In this way, the AMA would expand its present programs to 
approve existing offerings and stimulate new efforts in 
its constituent state societies. 

3. What is needed is clear statement of the AMA role as a 
natural partner with RMP in assessing needs and civaluating 
performance, and as a natural partner with universities or 
medical schools in continuing education. 
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4* Further, the AMA should formally invite others to help design 
and join a new sector for genuine collaboration in all aspects 
of continuing education. 

This could be called the "health professions education coun- 
cil"; with regional, state and national components; each 
composed of AMA, university and RMP elements (plus any other 
pertinent representation) . 

This sector would guide operations of a total system from 
identification of needs to curriculum to programs, to eval- 
uation and feedback* 

The existence of this device would interrupt current sepa- 
ration where AMA, RMP, universities, various professional 
societies and multiple other forces jjroceed unilaterally in 
continuing medical education. 

Incentive for Learning^ ; 

Under increasing public pressure, many leaders in medicine fore- 
cast that the problem of maintaining professional competence in physicians 
will result ultimately in periodic mandatory relicensure. In the absence 
of valid criteria for measuring "professional competence", the medical 
profession remains divided on this issue. An ad hoc committee of the 
AMA*s Committee on Education proposed recently that regular participation 
in continuing medical education should be the condition for relicensure, 
buc the only concrete action the AMA has taken in this respect is to 
offer a 'Recognition Award' to physicians participating in continuing 
medical education. For those physicians wishing to qualify, "the 
requirements are 150 credit hours of continuing education in a period of 
three years, 60 hours or more made up of required educational activities 
and the remaining 90 hours, in electives" (184). According to most 
accounts, physicians have responded well to this voluntary accrediting 
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scheme and at the completion of Its first year, more than 14j000 phy-* 
slclans are reported to have qualified for the award (61). 

The California Medical Association Is Issuing a similar award 
of a "Certificate in Continuing Medical Education" but has extended the 
scheme to cover a wider range of informal educational activities* Upon 
receiving this Certificate, physicians automatically qualify for the 
AMA Physician's Recognition Award (128). Since its inception, the 
Academy of General Practice has required participation in continuing 
education as a- condition for membership, and recently the Oregon State 
Medical Society followed this lead by making regular participation in 
continuing medical education a condition for membership (182) . There 
is some concern being expressed as to how much effect this loss of 
state medical society membership would have on the chronically non- 
participating physician. Many feel that such physicians are better 
"under the umbrella of organized medicine than outside it" (6) . 

Stein (236) reports that "while the general subject of re- 
examinations and re-certification of licensed physicians has been 
repeatedly discussed by the Federation of State Medical Boards and by 
the National Board of Medical Examiners, no definite decision has been 
reached." The newly established American Board of Family Practice has 
' stipulated recertlfication every six years (55)^ and recently, the 
American Board of Internal Medicine announced its intention to implement 
a recertif ication procedure (118) . 
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The American College of Physicians has devised a voluntary exam- 
ination for internists which serves as a self -assessment test. It is 
hoped that this will help an individual internist become more aware of 
his deficiencies in medical knowledge so that he will seek ways to 
correct them. Initially, 5,000 of the 150,000 ACP members took the 
test, and since that time, an additional 5,600 members and non-members 
have participated. According to Rosen (213) , the reactions to the 
examination have been enthusiastic. More recently, the American Psy- 
chiatric Association (40) , the American College of Pediatrics (69) , 
and other national specialty associations (142) are reported developing 
similar programs. 

Commenting on the varied approaches currently being tried in an 

effort to ensure professional competence. Miller (159) writes: 

The purpose of licensing is to certify that competence has been 
achieved, not to spell out the method of achieving it, or 
equating participation in a specified number of wholesome activ- 
ities with achievement of the goal. The American Academy of 
General Practice has already done so and is often commended 
for the courageous decision that made participation in accred- 
ited programs of postgraduate education a requirement for con- 
tinued membership. One can only applaud the motives that led 
to this decision, but the thoughtful may question the philosophy 
underlying it and the practices accompanying it. For the 
spirit of this resolution seems to say, that having led a horse 
to water, yoli can make him drink. 

In the same vein, a recent statement issued by the Committee 

on Medical Education of the New York Academy of Medicine (55) concludes: 

...that certificate concept, if judged only on the basis of 
total number of hours in some kind of postgraduate course is 
fallacious is that it implies unwarranted merit to course work. 
The committee also strongly opposes- any mandatory examinations 
for maintenance of the currency of one's medical license. The 
available Informatio^a does not support a positive relation be-r 
Q tweeh the results of most such tests and the quality of care 

ERXC provided by practising physicians for taeir patients... 
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Accordingly, this committee recommends: "the establishment of 
programs based on management type or audit type procedures whereby both 
hospital and community physicians may participate in mass audit exercises, 
reviewing each other's charts or record room charts generally, to indicate 
features of particular diseases which must be considered and appropriate 
approaches in their management." 

Whatever the merits and/or limita. as of these varied approaches, 
clearly the trend is "to give recognition for participation in continuing 
medical education" (61). 
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CHAPTER IV 
INSTRUCTIONAL PROCESSES 

In the literature describing programs of continuing education 
In medicine, the terms applied to instructional processes are used 
indiscriminately and without either precision or consistency* Since 
the descriptions of the processes are inadequate to allow translation 
into the standard terminology of adult education it will be necessary 
to summarize the literature as presented rather than attempting to 
synthesize it. 

Among other things, the reports of programs do not clearly 
differentiate between the methods and techniques employed (255). Never- 
theless it is possible to Identify the major methods. The most used 
method is that of the course or class with three major variants or 
patterns of this method being the continuous , intermitten t , and circuit 
courses described earlier. Other methods encountered include ward 
rounds, case seminars, clinical conferences , clinical practice, and the 
discussion group. The literature in which tLase methods are discussed 
is primarily descriptive and there is scant evidence of attempts to 
assess the ef f ectiveness^ of the methods nor. to compare one with 
another. 

The techniques of instruction reported are equally poorly de- 
fined and described so that terms describing methods are used inter- 
changeably with those identifying techniques. Furthermore, instructional 
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aids or devices are often treated as instructional techniques. The 
resultant confusion in language makes It virtually Impossible to assess 
the comparative effectiveness of various program designs with any valid- 
ity* It is clear that those conducting programs for continuing education 
in medicine ^ire not knowledgeable about how leartilng occurs in adults 
or the conditions essential to achieve learning, nor are they skilled 
in the design and management of instruction, 

PATTERNS OF INSTRUCTION 

While no one technique can be thought to. outweigh all others 
in Importance, those which facilitate the immediate application of ' 
knowledge are generally considered to be superior to those in which 
the learner is a passive recipient of infotrmation. In continuing med- 
ical education one of the greatest problems has been the excessive 
use of non-participative or didact:* / techniques. 

In 1940, ,Rappelye (227) stated, "too often postgraduate medical 
instruction has been given solely by didactic lectures .. .while didactic 
lectures are valuable, demonstrations, firsthand experience under 
guidance, and conferences are the most successful forms of teaching.- 
Any well conceived program should stress these methods"* This recom- 
mendation, variously expressed, was repeated by Norwood (174), Vollan 
(256), Dryer (79), and in many other reports. In 1957 the Council on 
Medical Education Incorporated the recommendation In its Guide , along 
with a lengthy explanatory section en specific ways to increase partic- 
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In the maantlme, courses reported in the Annual Listing have 
consistently publicized the use of a wide variety of participative tech- 
niques. Thus the Council's review of the 1964-1965 Annual Course Listing 
revealed that of the 1,529 courses listed, only 22 percent specified the 
use of solely didactic formats defined in this survey as "the lecture, 
the lecture and brief discussion period, or these plus panel discussion 
and audio-visual aids" (57). Using the same restrictive definition, 
of the 2,016 courses listed in 1969-1970, roughly 20 percent indicated 
the use of only non-particlpatiye techniques. All other specifying the 
lecture and such things as the seminar, laboratory work, or clinical 
conferences (59). 

These figures alone are misleading, since the majority of courses 
in continuing medical education are both short term and for large groups. 
When enrollment reaches the hundreds, and time is limited, it becomes, 
extremely difficult to incorporate a variety of techniques which would 
facilitate active learner participation (57) . It is not s^urprising 
therefore, that in actual practice, while the purely didactic format is 
no longer reported (220), the majority of sponsors still make use of 
the lecture, symposia, panel and other didactic techniques (129) (267). 

The. Council's survey in 1956-1957 revealed that a significantly 
larger proportion of courses sponsored by medical a«d specialty societies 
used solely didactic techniques (57). More recent ^counts suggest that 
the situation remains relatively unchanged, but the structure and quality 
of programs Is said to vary considerably according to the particular 
society involved (263). Thus, the California Medical Society is reported 
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re-shaping its programs to facilitate greater physician participation 
and in 1968, seven regional postgraduate ±\ i cs were held with 885 

participants but with a faculty-student ratio of 1:10. Similarly some 
of the national medical conferences and conventions are also reported 
using more small group methods such as seminars or clinics (230) (263) . 

Rhue (220) reported that in 1963, 43 percent of the responding 
medical schools indicated that they were using the lectare alone or 
lecture plus question period; 2l percent live clinics; 20 percent group 
conferences and seminars; 9 percent laboratory work; and 7 percent bed-^ 
side rounds. A more recent unpublished survey of Canadian medical schools 
reveals similar findings (241). 

In both Canada and the United States, the expansion of regional 
programs suggests that greater use will be made of small group seminars, 

specialised clinical practice and other more participational techniques in 
the future (235). 

Of the^ specialties , psychiatry has consistently offered the 
greatest number of courses with eurollmeiii. liinited to small groups 
(arbitrarily defined as any learning group with 25 participants or less) 
and, as previously noted 9 It makes the greatest use of intermittent 
scheduling (59) • 

SMALL GROUPS 

The small discuss xi^i. group r<Rf erred rrlously as the seminar 

or clinical conference. Is wid^iv j o^fCi In contv'xiuing medical education 
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but, as previously noted, surveys disclose that many physicians prefer 
the formal lecture. Sheeley (226) reports an experiment in which an 
institution 'jffered the same psychiatric course ^simultaneously by two 
different methods 5 a series of lectures and a series of discussion 
sessions. The lecture series had over 25 registrants while the dis- 
cussion series attracted none. Since acceptance and active participant 
involvement are two primary factors in the effectiveness of the dis- 
cussion group method, it may be useful to illustrate its use. 
Psychiatric Case Seminars ! 

In reviewing the varying results of a psychiatric course for 
non-psychiatrists held in three Washington counties over a three year 
period, Stuen and his associ.^tes (239) concluded that many physicians 
are not capable of taking part in the free give and take of the psy- • 
chiatrlc s^^minar which can be a traumatic experience initially. They 
recommend beginning with a didactic approach then gradually shifting 
to the study of case materials ^mti the use of discussion. In Brooklyr«, 
Brody (31) found that by keeping the group under ten, even the most 
"diffident physician actively participated in discussion." 

Reporting on uhe psychiatric case seminar used- in the four 
state Utah project. Mead and Fishman (151) concluded that the degree 
of physician participation was directly related to his familiarity with 
psychiatry, thus those physicians who most needed help with their cases 
were least likely to receive it. He also concluded that concentrating 
solely on cases from the physicians' practice resulted in insufficient 
preparation in basic methodology so that the Utah project was modified 
O include lectures as well as case oriented discussions. 
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To circuinvent the problem of a physician's reluctance to dis- 
cuss case problems in the psychiatric group setting, the program in 
Elmhurst, New York incorporated an hour's consultation service prior 
to each seminar > as well as offering Individual psychiatrist consul- 
trttions by appointment (22). 

Commenting on the current widespread use of their original 
psychiatric case seminar technique, the Balints have emphasized that 
"such ventures, no matter how greatly modified, require much more time 
than .e popular veek-end G.P, course" (17). 
Clinical Conferences s 

One of the more inteutiive Cypes of clinical conferences reported 
is the consecutive case conference (CCC) devised by the American Heart 
Association. In this, a panel of experts analyzes the charts of ten 
patients consecutively discharged. The physicians are required to 
account for their conduct of each case as it comes under revien^. Al— 
though Williamson and McGuire (270) stress that the purpose of tL^ CCG 
is educational, namely, to provide "an opportunity for physicians to 
reflect back on their own performance and to gain insight into the 
management of th'i case with the help of acknowledged experts", most 
writers agree (254, 263, 282) that it requires considerable ego strength 
on the part of the practising physicians. A study by Williamson and 
KcGuire (270) which compared the relative effectiveness of the CCC 
an\i the lecture in improving clinical judgement found "no overall 
significant difference as tested by simulated patient problems six 
months after completion of the instruction." 
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More successful programs using this approach have stressed the 
anonymity of individual physicians and focussrr' on group problems and 
group problem solving (97, 161, 235). Vaneslow (254) quotes Slee as 
saying that some medical directors have committed "p-af esslonal suicide 
because they failed to take into consideration the worries of the medical 
staff regarding the possible consequences of a program of this type." 

Far less threatening and therefore widely used in community 
hospital programs is the clinical conference using the physicians' own 
case material as a basis for general discussion. Cudmote and Tippett 
(67) reported a preliminary study that compared the results when one 
group engaged in extra preparation prior to a visiting treacher program 
and another did not. Follow up interviews with physicians revealed 
that the amount or preparatory work undertaken by the two groups did 
not differ significantly despite the extra encouragement given to the 
experimental group. 

At McMaster University a time log is kept to determine whether 
there is a progressive change in the amount of discussion time used 
by the visiting faculty versus the learner group. Results to date 
have shown no significant increase in the time utilized by the practising 
physicians participating in the program (11). 
Demon s trations; Supervised Clinical Practice ; 

In psychiatry a number of courses are reported which combine 
the case conference approach with pacient demonstrations, return dem- 
onstration, and supervised clinical practice. In these programs feed- 
back provided through the ?;se of the two--way mirror and/or vidcetape 
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serve as the basis for group discussions (26) (2'8) (274). Also re- 
ported from this field are successful uses of psychodrama and role 
playing (26). A typical example is that described by Levinson (140) 
in which the physician participants re-enact patient situations prior 
to and following their clinical experiences = Fleisher (98) reports 
that at the University of Southern California, professional actors have 
been trained to play the role of patients • This device has been devel- 
oped further at Michigan State College and the University of Colorado 
where preliminary work indicates a fairly reliable degree of object- 
ivity on the part of the actors, thereby suggesting that an assess— 
ment of student learning could be possible* 

In contrast to the foregoing. Kern ^t^ al^ (130) at Johns Hopkins 
University have des^cribed an experimental project in community psy- 
chiatry using what they call "The Demonstration Week" in which practising 
physicians experience the same unstructured field work as that used in 
training r<^sidents. This has been evaluated by physician responses to 
questionnaires which suggest, that this technique is placing responsibil- 
ity on the physicians for their own learning and, in an ambiguous 
situation requiring frequent changes of style and roles, is capable of 
fostering self -learning and an attitude favourable to implementing 
change. 

A number of programs reported also provide evidence of a move- 
ment from the classroom to the clinical practice field. Richardson (202) 
dencrlbed a visiting teacher program conducted in one small community 
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hospital in Pennsylvania in which a consultant allergist visited the 
allergy clinic every t^>o weeks. At this visit, sjiecialized tc^chniques 
were demonstrated* The local physicians practiced the techniques under 
superv. nd formulated therapeutic plans for selected patients. 

Between clinic sessions , the local staff physicians implement the pro- 
posed treatment plans. It is the aim of this program. to decrease 
gradually the number of consultant visits and increase the transfer 
of responsibility to local physicians. 

Similarly, St. Justine's Children's Hospital in Montreal has 
reported a consultation service in which two to three pediatricians 
spend two days in a commun.-^ y hospital. In the morning they meet with 
family physicians and do ward rounds , reviewing all cases . In the 
afternoon they see outpatients whom the family physicians present for 
examination and consultation. According to Rosier (215). this experi- 
ment is proving fruitful, "not only in continuing medical education, 
but also as a way of providing the public with the services of a qualified 
consultant . " 

Goldfinger and Federman (106) have described a successful refresher 
program in which .three general practitioners served as housemen In the 
emergency deparf:ment of a teaching hospital while receiving formal lectures 
and eupervized clinical instruction on the latest intensive care techniques. 
While this program illustrates the typical traineeship in most respects, 
what is g£ particular interest is that the emergency nature of the ward 
responsibilities automatically defined the physicians' real learning needs. 
On the other hand. Brown jet al (33) described an experimental project 
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at Pacific Medical Center designed to retrain inactive physicians in 
which it was found that the conventional traineeship program was in- 
adequate for a group who were not only reluctant to assume patient 
responsibilities y but also required a systematic review course using 
didactic instruction. They recommend that the curriculum for phy- 
sicians in this case should consist of two phases: first an inten- 
sive review course on basic aspects of clinical medicine and second 
a program of supervised patient contact with a gradual assumption of 
responsibility. 

The only report of an ongoing inserv^ce training program en- 
countered in the literature was that described by Jampol and others 
(124)* Sponsored by 60 physicians in group practice, this program 
utilized small group bedside session with emphasis on clinical diag- 
nosis and the management of the part„ .x^^ant's own patients. A follow 
up medical audit after two years indicated that, in general ^ "more 
appropriate laboratory and X-ray studies were being ordered in pro- 
blem cases, with less tendency to initiate therapy before diagnostic 
studies." Consultant specialists also felt that better patient assess- 
ments were being performed prior to referral and that referral notes 
displayed a fuller understanding of the problems involved. 

Using a simulated coronary care unit at the Pacific Medical 
Center, the Washington/Alaska RMF is conducting regularly scheduled 
classes on coronary care for multiprof essional health personnel. The 
equipment used for classr^DCrm instruction and which is available for • 
loan to other centers conducting similar programs include: tapes and 

O 

EKLC 



83 



monitors for teaching the arrthymias; A.V. presentations (slides; film 
cartridges; and films trips) on the care and treatment of heart d:7f:,ise: 
and computer programming on various coronary care topics. In conjunc- 
tion with these classes, consultative services are provided and post- 
graduate preceptorships are arranged for physicians (261) . This program 
has been rated so highly that other RMP are reported developing similar 
or modified programs (252). 

LARGE GROUPS 

Instruction provided to large groups must focus on techniques 
which will enhance participant interaction* Despite the widespread use 

large groups, there are few studies reported that involve such groups. 
The two descriptive studies selected for this review are particularly 
informative. 

Harshbarger (112) investigated a community mental health work- 
shop attended by some 80 individuals from various health professions. 
He had participant observers gather data on the pei-tinent issues dis- 
cussed in the small buzz groups and a comparison was made of the observers' 
summaries and the reports made by each buzz group to the total group. 
Their findings revealed that while stimulating a:»d meaningful problems 
were raised in the small group sessions, these were not reporteid back 
to the total group. Instead, "professional overpoliteness" characterized 
most of the reports. This study concludes: "If workshops arc. to be 
creative forums for new ideas the traditional roles of the various 
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professional participants must be disrupted." The recommendations 
stress the need for more effective feedback mechanisms such as that 
provided by participant observers who woujLd ensure that the essential 
contrasting professional viewpoints would be relayed to the larger 
assembly for further discussion and clarif l.:ation. 

Schleslnger and Fell (221) reported a questionnaire evaluation 
of a three day symposium on epilepsy presented to a diverse group of 
physicians and other health workers. They found that the highest mean 
rating was given to the didactic format and the lowest to exchanges 
between speakers, panelists, and the audience. They also report that 
there was a discrepancy between the objectives of the participants 
and ehe concent of the program. Furthermore, while general practi- 
tioners wssre relatively satisfied with the program, specialists ex- 
pressed dissatisfaction with the b-,:oad coverage of subject matter. 
Th<i nurse participants expressed a high degree of interest In all' 
topics yet, the author noted, "the subject matter was geared to phy- 
sicians and much of it was only indirectly relevant to the nurses' 
interests." One may infer that the findings of this study merely 
reiterate one of the basic problems inherent in large learning groups— 
"How wide a net should be cast, and how large should the opening be?" 

MASS MEDIA 

The radio, television, and the telephone are three of the most 
ubiquitous coiCircuuication r'evices in Worth America. All three of these 
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have been used for many years to diffuse new medical information to 
physicians but it is only recently that they have been adapted . to pro- 
vide systematic instruction. These media provide a way of extending 
the range of an instructor to many groups and obviate the necessity of 
forming a specific instructional group at a specified location with an 
instructor present in person. In some respects, they have been used 
more extensively in continuing medical education than In any "other sub- 
ject area. This is due> no doubt, to the fact that the potential partic- 
inants are clearly identified and the motivation to learn is generally 
high. Unfortunately this pattern of instruction has not been studied 
adequately* 
Radio Conferences ; 

A most noteworthy innovation in continuing medical education 
has been the two^-^way radio conference pioneered by Woolsey at Albany 
College in 1955 (279) • In the typical program, physicians gather 
around a combination transmitter and receiver set located in their 
community hospital. Following a brief lecture by medical school per- 
sonnel, physicians in the participating hospitals take turns in sub- 
mitting questions and comments to the lecturers • Frequently, slides 
and other supplementary materials are distributed to the hospiuals In 
advance to be. used in conjunction with the program. Initially, 21 hos- 
pitals were linked with the medical college. In the fourth year of 
operation, five New England Medical colleges and their affiliated hos- 
pitals were participating in the network. Physicians in affiliated 
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hospitals were provided with an opportunity to listen and to direct 
comments and questions to faculty experts from six different medical 
colleges. In 1963, Ebbert (80) estimated that appro3cimately 1,298 
physicians in 36 hospitals were being reached by these radio conferences. 
In addition, the number of uncounted physicians who listed to the pro- 
grams was thought to be considerable. The cost to each participating 
hospital in the Albany Network is $700 per year per hospital. This 
fee covers more than one hundred programs and the supplementary Instruc- 
tional materials. Woolsey (277) also describes a new program format 
being offered co-operatively with six medical schools in 15 participating 
states. This program is presented as a medical case which the phy- 
sicians first analyze on a special form listing a variety of possible 
tests and procedures. After each participant has decided on his diag- 
nosis and treatment, the instructor analyzes the case and presents his 
approach to the problem. When the presentation has been completed, phy- 
sicians discuss the case management via two-way radio. Preliminary ' 
studies suggest that physicians become more skillful in their diagnosis 
after experience with this approach to case management. 

Farber (95) estimates that more than 800 physicians within a 
500 mile radiu© are participating in the programs conducted by the , 
University of California School of Medicine. More than 1,510 copies 
of lecture notes and Cc\se presentations are mailed each week to partic- 
ipating hospitals. Many hospitals tape the programs so that physicians 
may hear any broadcast at their convenience. To date, the findings of 
the California experience show that the greatest response has been from 



general practitioners. Farber concludes: "medical radio confeiences 
have been a major step forward in bringing the most recent concepts into 
outlying districts with a minimum of expenditure.'' 

There have been few, if any, meaningful evaluations of the effec- 
tiveness of two-way radio conferences. The only objective evaluation founc 
was that undertaken by Richardson et^ al (201) in 1963* This study at- 
tempted to evaluate a radio series through the use of before and after 
tests for knowledge gain. Using a sample of 70 volunteer physicians 
who had participated in the program, and a control group consisting of 
12 non-participants, Richardson was able to show a statistically sig- 
nificant mean score difference of 1.6 between the first and ivr>zond tests 

for the experimental group, and no statistically significant difference 

ft 

for the control group. 

The medium of radio has scarcely been used in Canada for con- 
tinuing medical education. The only report of a viable program en- 
countered was from the University of Albertao In 1968, a series of 
twenty-one radio seminars were offered. These were considered to be 
successful, so it was planned to extend the broadcasts (7). As a part 
of its proposed Multi-Media Information Retrieval System, the University 
of Saskatchewan plans to establish a province-wide radio-telephone - 
series In co-operation with the C.B.C. (13). 
Ke dical Radio Network: 

Altken (4) reports the establishment in Boston of a MeJical 
Radio l^^stwork which broadcasts musical programs into the jparticipatlng 
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physician's office tvrelve hours a day. The music is interrupted every 
hour by a fifteen to thirty minute medical program to which the doctor 
may listen, with three opportunities each day to listen to each of the 
four programs offered. 
Telelectures : 

A pilot project to provide continuing education to physicians 
via teleloctures or amplified telephone at the University of Wisconsin 
bas been described by Meyer et aa (156). Initiated in 1965, seventy 
hospitals are linked by private telephone lines to the University Med- 
ical Communication Center. The general program format follows that 
used with the two-way radio conferences, including a brief lecture with 
slides followed by a discussion period. Participating hospitals take 
turns submitting questions and comments. In the 1967-68 academic year 
80,000 hours of instruction were given with "neither faculty nor stu- 
dents moving away from cfe««£i;r compunis^fie^i l3teir Igeaiti cBtgx^^^ respoir- 
sHfibilitie Portney Ci<£il) r-epoT^2:s tsfcai: the Missouni 3^ bsa^ ^<^ablt3i»iieg 
a similar telephone netw^ra: linking many of the remote hospdLtals in 
Missouri with the university's medical center. 

The South Carolina RMP is offering consultant conferences in 
the field of malignant diseases of children via statewide telelectures. 
Plans are underway to make videotapes of patients as well as of special 
diagnostic and therapeutic procedures which will be sent to each of the 
participating hospitals. Simultaneous viewing will then Ve possible 
during the conferences (166). 
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In contrast, Lyons (143) reports limited success in the Central 
New York RMP experiment with telephone networks. Among the many tech- 
nical problems discussed, he notes that faculty unfamiliar with the 
method are often uncomfortable talking to an unknown audience and that 
physicians are equally reluctant to ask questions. He notes further 
that nurses and medical technicians have made grea::er use of the net- 
work than have physicians. 
Television ; 

During the past fifteen years, television has probably received 
more attention than any other medium. Referring to its use in con- 
tinuing medical education, Ohliger (176) states, "Mass media courses 
for the medical profession ate blossoming all over the map, but mainly 
in the United States," and he quotes Moses as saying, "Sducational 
television has proven to be immensely useful in keeping doctors abreast 
of advances in medical practice. . ." 

Despite all the publicity surrounding its varied and widespread 
use, closer scrutiny reveals that the use of television has spread 
rather slowly (193). Moreover, much of what is in use is still exper- 
imental (111). Since Harris (111) has reviewed so recently the pub- 
lished literature on closed circuit systems, this report is concerned 
largely with the use of open circuit, standard receiver, and scrambled 
or encoded broadcast television. 

In 1954 Warner and Bowers (259) reported the first use of open 
circuit television in postgraduate medical education at the University 
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of Utah. The program consisted of a series of medical clinics and was 
telecast over a commercial station in Salt Lake City, that had a range 
which included 75 percent of the practising physicians in Utah, In 
order to minimize public viewing, off air time was used and publicity 
was restricted to direct mail to the physicians. To promote partic- 
ipation, an unlisted telephone was Installed and physicians were 
encouraged to plac^j questions by collect calls. The success of the 
experiment was attested by favourable physician ratings of the program, 
high participation by more rural physicians, and no adverse criticisms 
from the lay public. This resulted in the regular use of o^bu circuit 
television for continuing medical education by the Universiti" of Utah. 
After that experiment, Wayne State University , the University of Texas, 
the University of Oklahoma, and others began telecasting similar pro- 
grams on an experimental basis frequently uaing taipesiTnade at the Un±ver 
B±ly of Utah (^3). 

Commenting on the instructional techniques used in these early 
programs. Castle (43) notes: 

While the method of presentation has varied from illustrated 
lectures, panel discussions, question and answer periods, and 
demonstrations of procedures and patients .. .the approach most 
frequently used has been informal discussion between two 
teachers with liberal use of visual aids to demonstrate and 
emphasize salient features of the presentation. 

A slightly different approach at the University of Florida was 

reported in 1963 by Michael (158). This program consisted of a grand 

rounds type of presentation in which three local physicians served as 

one half of a panel In one studio in Jacksonville some sixty-five miles 
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away, with the other half consisting of faculty members located in the 
studio at Gainsville. A micro^-relay system provided an opportunity 
for an exchange of questions and answers following a case presentation 
in the Jacksonville studio. This approach was felt to "bring the 
university to the bedside teaching" and it was concluded that this type 
of conference was highly desirable. 

In Pittsburgh particular efforts have been made to involve local 
hospitals. In 1962 a series of regular weei<iy broadcasts cotasistlng of 
"li^" grand rounds and clos ing with a brief :2iedic^ newscast- was initi- 
ated in 29 commmtifaty hospitals. In 1965i, Mn^ses and Wolfe (167) reported 
an expansion of :this program to include 63 faospitals extendi ng: through- 
out the trl - s t p axeaiio f South Western Esmsyxvania^ lEaste^nn Ohio, and 
Northern West V±r^in±a« In 1967, 70 hcrgpd.ml5^ were partir1igia^lT?g; i±ii 
this netwnirk (17S)., 

A televised lecture series called "Boston Medical Reports" was 
launched in 1964 taking as one of its principal objectives, "the region- 
alization of medical education by means of television, expecting it to 
\ becom.e a part of a proposed university without walls." In this network 
were stations in Maine, New Hampshire, Massachusetts (209), and more 
recently, Rhode Island and Vermont (176), One noteworthy element of 
the series was the "Physicians' Notebook for the Boston Reports." 
Intended as a promotional attraction, prior to the telecasts a copy 
of a three ringed notebook with informative materials announcing the 
series, Its purpose and format was mailed to all potential viewers in 
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Maine. Subsequently, supplementary literature accompanying each lecture 
was sent to physicians to add to the notebook which could then serve as 
a reference source. Another important element of this project was the 
effectiveness studies which "provided continuous feedback to program 
planners so that they could modify future programs." 

Although attempts at an objective evaluation of the series 
were hampered by limitations of the research designs, it was felt "that 
Boston Medical Reports did provide a rswlew of medical topics .and for 
some viewers, significant-learning did take place." Moreover, it was 
fell:; itmat "the series lainiched a stroag aaivrement Jsaward a s^^eatier use 
of tmaBB cinnmunication techniques ir. Ntsi^ cr^ land," i^cluifisM^ the ±ni- 
r ifBtr m n of a similar series entitled "New England Dental Reports for 
Continuing Dental Education." In addition, it pioneered an effort at 
regional co-operation and presently a special package of 42 programs 
entitled Medical Reports, Boston, Buffalo, Pittsburgh, is being offered 
by the Eastern Educational T-V Network to its member stations. 

The total cost of each program was approximately $4,000 or about 
$4 per potential viewer and between $10 and $12 per actual viewer in 
Maine. Increasing regional distribution decreases costs and the estimates 
of the number of viewers per program range from 9 percent to 38 percent 
of the potential physician participants. Robertson and Pyke (211) con- 
clude! "Size of target audience must be weighed against cost, including 
time and effort to produce and broadcast television programs ... if the 
target eudience is small, television, a mass medium, may be less mone- 
tarily efficient and educatlpnally productive than other instructional 
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The Oregon Medical Association in 1936 sponsored a broadcast 
television series produced by a committee of seventeen members of the 
association. By placing this reponsibility on its active membership, 
it was hoped that practitioners would become mure involved in planning 
their own continuing medical education. The series entitled "The 
Oregon Medical Review" was broadcast weekly from January to April and 
focussed on content relevant to the role of the first contact physician. 
A study was made through mail questionnaires and follow up telephone 
interviews, using a represexttativc sample drawa frsam the potential 
viewing audience of 1,651 physicians. This disclosed that while the 
first five programs attracted relatively large numbers of viewers, 
interest was not maintained. The maximum number of physicians viewing 
any one program was 10.4 percent of the membership. From responses 
to the telephone interviews it appeared that the involvement of the 
membership of the Association in programming was achieved in theory only, 
perhaps "because the television committee. . •in their concern to get the 
job done, permitted the development of an organizational structure that 
was just as distant from the average member and involved just as 
hierarchic patterns as the sponsorship of other programs of continuing 
medical education*" Moveover, it was found that the program planners' 
frequently used individuals who were unable to adapt to the television 
medium. Even more important, was the failure to identify specific 
instructional objectives for each program. In conclusion, Meighan and 
Treseder (153) noted; "The medium provides a means whereby programs of 
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continuing medical educi-^tion may be dis tribvited wii 
some outstandingly attractive featuires. However, : 
ueational effectiveness is xrequiired to show that tl 
tractions are not illusory • " 

In 1963, the New York Academy of Medicine 1 
open circuit tel:evision its weekly Clinical Scienci 
sicians. The purpose of this project was "to ascei 
ability and effectiveness of television as an addil 
continuation medical education in a metropolitan ai 
peated polls, th-a si:se, compositloxi , and opinions c 
ipating in the program were studied. In addition, 
determine the impact of the program or>, its audience 
information test which was administered to lOO vio\ 
viewers covering a period of from four to eight mor 
sentation of selected programs in the series • Wh: 
this study were somewhat clouded by time variables - 
dicated that no specific learning could be demonsti 
mulatively, polls revealed an audience averaging ot 
of the potential viewers that was attracted to the 
C148) • Considering the expense and effort, so smaZ 
xiot justify contixiuing the program, so it was texrmi 

Fahs and Millar C9A) described the evaluate 
broadcast in the state of Minnesota between 1967 ax 
nine programs of the eeric^s were analysed fierom fchrc 
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1) the accuracy and recognition of scientific information; 2) the success 
in communication; and 3) the relevance of the programs to the care of 
patients. Four panels of physicians who were specialists in the areas 
covered by the programs were selected to make the evaluation. A compar- 
ison was made also of the actual and potential viewing audience "with 
information on why physicians did not watch and what insights came to 
those who watched." 

Since objectives for specific programs were not clearly defined, 
the panelists were hampered in their attempts to evaluate themo In 
general, the scientific content of the series was judged to be adequate, 
reliable, and accurate* With respect to communication and technical 
production, the comments of the panels were unmistakably negative* As 
one panelist put it^ "These gentlemen communicating with each other ^bout 
their own habits of practice just don't convince me that I want to emulate 
their style." Another concluded, "One program could have been put on 
audio alone with no need for vision. The appearance of the panel, unless 
its personalities are dynamic, is less than worthless." 

Comments from viewing physicians suggested that "a considerable 
amount of program testing occurred ^ and where one program was useful to 
the physician in his practice, he tried others. Conversely, when he re- 
ceived no benefit he. quit watching. And the more programs the physician 
saw, the clearer it was that he was getting something out of the series." 
The major reasons glveti by physician .for not ,vjLewing were: not knowing of 
the program's existence, forgetting to watch, or being too busy. Some 
also indicated that they preferred to watch the ten o'clock news. The 
authors conclude: 
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No one doubts that continuing medical education through tele- 
vision has potential. However, few beli^ve that its full 
potential is presently being utilized, and virtually all are 
willing to experiment to some extent. This evaluation reaffirms 
such generalizations and hopes that continuing effort be 
applied to both new and old methods. 

A number of medical centers in Canada have reported some ex- 
perimentation in the use of broadcast television for continuing medical 
education (11, 119, 253). The general impression gained from the . 
literature is that most Canadian productions have followed the typical 
American format: namely, lectures or panel presentations followed by a 
brief question and answer period. As in the United States, the prob- 
lems of technir^al production, costs relative to viewership, and diffi- 
culties in evaluating the worth of televized programs , have been 
identified as the major obstacles in the use and expansion of the 
medium (119, 253) • 

Encoded or Scrambled Broadcast Television ; 

While no studies encountered to date have revealed specific 
reactions frOm lay viewers, the question of complete professional 
privacy is still being debated within the medical profession (263) , 
and this has resulted in a network of medical schools and affiliating 
hospitals in California using scrambled or encoded broadcast tele- 
vision (30) (165)* 

Under this system, the picture appears on the standard tele- 
vision screen, but in encoded form thus preventing public viewing. 
Decoding or unscrambling is accomplished by a modified receiver. 
Because these decoders are still relatively expensive they have been 
placed only in the affiliating hospitals in the California experiment. 



This is believed to have several advantages : 1) it makes the commund 
hospital the center for continuing medical education, 2) it makes fea 
ible an accurate record of the number of viewers of each program ^ anc 
3) it makes it possible for the universities to charge a tuition fee 
for participation in the network, which in turn makes superior prod- 
uction techniques possible (30) . 

The success of an initial pilot project linking 15 community 
hospitals with the University of California in 1965, resulted in the 
expansion of the number of participatinf? hospitals and the merging of 
six major medical centers and their television facilities to form the 
Medical Television Network (MTN) for the production and distribution 
of televized programs. At the end of the second year of broadcasting 
Brayton e^ al (29> reported 72 hospitals participating in MTN with ar 
additional 18 hospitals participating in a video tape distribution 
system whereby hospitals received the programs on one inch videotape 
which could then be played on relatively inexpensive video recorders* 
Thxough a contract with the United States Public Health Service, the 
MTN is currently operating with a professional staff and facilities, 
consequently, the quality of the programs has been greatly improved b 
the tuition charged liospitals has been lowered substantially. Atten- 
dance data shows that MTN broadcasts are reaching some 750 physician 
viewers each week and that approximately 28,000 hours of instruction 
are provided in the 38 programs offered yearly ♦ Since most of the pr 
grams have generalists as their target audience, it is not surprising 
that the greatest number of viewer«3 have been general practitioners a 



Internists, with specialists in the na-^ 



:les being the 



least motivated to participate. In 1 



eL al (30) reported 



that: 



the MTN videotape reduplication and distribution system has 
been re-organized to combine the Southern California tele- 
vision resources with those of a similar encoded network in 
San Francisco for Northern Calif ornia. ••The resulting videotape 
distribution system, now called the California Medical Tele- 
vision Network will reduplicate and pool the outstanding 
programs broadcast for medical and paramedical education in 
each area and regularly distribute these to participating hos- 
pitals^^^In this way, the combined medical faculties in the 
most populous state will form the academic base for continuing 
medical and paramedical education using the newest television 
modality. 

Despite such optimism regarding the future of encoded broadcast 



television, in a recent report of an evaluation of four programs spon- 
sored by the Northern California Network, Mock et al (165) concluded:. 



While most of the assessment techniques in this study encoun- 
tered serious sample depletion, given this limitation... 
virtually no measurable changes in either behavior or infor- 
mation level were found which could be directly attributed 
to the prograu^^^ . . .It was noted that two hospitals changed 
their infection control procedures, but does this make the 
series worthwhile? The answer to this question would require 
an objective comparison between postgraduate medical television 
and other teaching media. The studies which will provide an 
answer to this question remain to be done. 

More pointedly, Lauler (55) concludes: "The exploitation of 



a given medium without leveraging its advantages in juxtaposition to. 
other media doomed the television medium to failure. . .The major limi- 
tation of the production of television or movie material resides in 
the software aspect." 
Slow Scan Television: 



An experimental project currently planned at the University of 



Wisconsin will use slow scan television carried by a telephone and radio 



link from the classroom at the Medical Communication^ Center to four 

small community hospitals with reception facilities. As described by 

Meyer et al^ (156) ! 

Using this medium still snapshots are transmitted over ordinary 
telephone wires thus obviating the need for expensive co-axial 
or microwave relay systems. Special receivers store the pictures 
and release them approximately eight minutes later... Thus the 
participants in the community hospitals have the live voices, 
the slides, and other visuals used during the conference as well 
as the still pictures. 

Other attributes which' make slow scan television attractive are: 

Its ability for random access information retrieval so that 5,000 
hours of instruction and 10,000 visuals can be stored, retrieved, 
and shown in remote points. In addition. It holds the ability 
for hard copy printout at remote locations so that printed infor- 
mation inserted at one end of the system can be faithfully re- 
produced at the other without teletypewriters, a sort of long 
distance Xerox ^lachlne* 



SUPPORTING DEVICES 



The supporting devices reviewed here are those educational 
technologies which have found their greatest use as quick Information 
sources, or as a means of self instruction. 
Motion Pictures; Videotapes; 



Probably the most significant development In the area of films 
has been the establishment of a Single Concept Film Service offered by 
the University of Wisconsin. Community hospitals are provided with a 
small portable projector along with single concept films on new medical 
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techniques which are on loan for six weeks • Each film runs from six 
to ten minutes and contains only essential information. When the user 
presses a lever the picture an' start Immediately. Since the 

film is self re-winding, he c ' the film a second time merely by 
pressing the lever again. Meyer et^ al, (155) report that a series of 
six films are in circulation among 47 hospitals in Wisconsin. A recent 
survey based on approximately 1,600 questionnaire responses from prac- 
ticing physicians revealed that 93 percent of the respondents felt that 
the films provided useful medical information. 

According to Wenrich (263) pharmaceutical companies hava also 
produced a number of films and TV kinescopes which are loaned to hos-^ 
pital and medical groups. The Upjohn Company has produced a series 
called Grand Rounds on 16mm film which is available through its regional 
offices. Similarly, the Roche Medical Laboratory produces videotapes 
for its "network for continuing medical education" which includes hos- 
pitals across the country. 
Audio^-Tape Recordings and Disc Services ; 

Probably the oldest and most established tape recording sub- 
scription service in operation is Audio Digest, a non-profit subsidiary 
of the California Medical Association. Oakley (175) reports that some 
30,000 tapes are sent each month to subscribers in the United States, 
Canada, and overseas. These tapes, ranging from one half to one hour 
in length, represent edited portions of lectures, panels, discussions, 
and symposia published in current literature. The areas of medicine 
covered by this service include general. practice, internal medicine, 



surgery, obstetrics and gynecology, pediatrics, anesthesiology, and op- 
thalmology. Important meetinys are also taped and sent to subscribers, 
Wenrich (263) reports that Ex cerpta Medica has begun producing "Voices 
of Medicine" weekly tape recordings of abstracted literature 

and feature presentations on selected subjects* The American College of 
Cardiology, in collaboration with the Radio Corporation of America, has 
begun a monthly tape service called Access Library Service focussing on 
subjects which have the greatest relevance to the practice of cardiology. 
(1A6). 

While the aim of these services is to provide a way that busy 
practitioners can acquire information by listening in their homes or 
while driving to work, reports suggest that only a certain proportion of 
physicians are attracted to this process (4, 37, 263). A study reported 
by Aitken (4) found that of the 655 tapes requested and sent out in 1961, 
29 users who took ten or more tapes each year used 513 of the total. 
Another finding of interest was that 60 percent of the tapes requested 
went to general practitioners in the coi.ntry or small towns. In 1962, 
the Canadian College set iip a disc service using twelve-inch long-playing 
discs in which the members of the service retained their own recordings. 
This proved extremely popular, and by 1963 a number of listening groups 
had formed. 

According to Harris (111), Smith and Hoist Incorporated in 
California have developed a series of illustrated medical lectures using 
both film strips and tape recordings produced by Lbma Linda University 
School of Medicine. These lectures range fron\ anesthesiology, Internal 



medicine, ohbti^LtlcSf cancer, and cariovascular disease to urology* 

Abrahamson and his colleagues (3) at the University of Southern 
California report a recc^.nt evaluation of a special self -instructional 
device combining a seven inch record with a film strip* In this study > 
100 general practitioners selected by stratified random sampling in the 
11 Western states served as the experimental group while another 100 
served as controls. Fifteen programs were circulated to the physicians 
participating in the study. Assessment procedures included: 1) post 
tests of information; 2) pre-atid-post project questionnaires assessing 
"communication behavior" and program acceptability, and 3) interviews 
of a sample of the physicians to validate questionnaire responses 
and to augment the data. Analysis of the data revealed a significant 
acquisition of information on all programs; high acceptability of the 
approach, but no significant change in "communication behavior" (defined 
in this study as "the way in which physicians attempt to obtain con- 
tinuing education"). 

In keeping with his basic philosophy that learning should be 
both fun and challenging, Woolsey (277) is developing a medical jukebox 
which will offer physicians 160 six-Tninute 33 1/3 rmp records, totaling 
16 hours of instruction. To illustrate the spoken word, two dial-access 
Carousel projectors have been integrated into the jukebox mechanism so 
that two by two inch color transparencies are automatically synchronized 
and projected. If the doctor has a question which the jukebox can not 
answer, a tape recorder will record the question with the physician ^s 
name and address, and It will then be answered by return mail* Another 



interesting feature will be that the user will be asked to evaluate the 

material presented at the conclusion of each record, rating it very 

helpful S helpful; slightly helpful; or no help, by punching an appro- 
priate button on the machine. Also being considered is the inclusion 
of an option that would require the physician to drop a quarter in the 
slot in order to get his program. At its conclusion, he would be asked 
a relevant question and offered four multiple choice answers. By pushing 
the appropriate button he would indicate his choice and if his answer is 
correct, his quarter is returned. 
Mediphone Services : 

In 1966, the University of Wisconsin pioneered a non-computerized 
Dial Access service. The objectives of this project were: 1) to make 
available current authoritative information twenty four hours a day for 
use in emergency situations, and 2) as a method of updating medical 
information. Intended strickly as a quick source of reference each tape 
is five to six minutes in length. When the physician wishes information 
relevant to any of the 230 subjects listed in the directory, he merely 
dials the toll free number designated, and requests the tape. In an 
average of twenty seconds after receipt of the call the tape is played 
for him over the telephone line. A preliminary survey in 1968 revealed 
that: 1) such a library had equal appeal to general practitioner and 
specialist in both urban and rural areas; 2) a significant number of 
physicians used the service as long as promotion was reinforced fre"^ 
quently, while a small number of practitioners used the library as an 
established source of information retrieval; and 3) a significant per- 
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cent of library ulllizatlon was for continuing education, that is, re- 
view, or updating knowledge or gaining new medical information^ On 
the basis of these findings, Meyer et^ al^, (157) conclude: "Whether on 
the basis of popularity or evaluation data it appears that there it* u 
sufficient degree of enthusiasm for this means of information retrieval 
and that the dial access library concept can be expected to experience 
rapid growth* " Minnesota and North Dakota are linked to the Wisconsin 
Library using their own separate communication systems. 

In Canada, the University of Saskatchewan has recently initiated 
a Dial Access Service. To date, "Three hundred and six five-minute 
messages have been received from Wisconsin and booklets listing uitles 
have been distributed to all Saskatchewan physicians. Twenty new scripts 
for messages have been completed by Saskatchewan specialists and twenty 
more are in preparation." Utilization of the service is reported satis- 
factory to date (13) • 

The Missouri RMP has sponsored the development of a Dial Access 
Library which differs from the Wisconsin Library in that the system is 
computerized. According to Fortney (101), "this makes the service 
chepaer and more efficient, eliminating the factor of human error." A 
number of medical specialists are helping to test the system by evalu- 
ating the messages from the experts' viewpoint and advising where cor- 
rections are required. Under the Alabama RMP the University of Alabama 
has recently become the headquarters for a "wide area telephone system" 
providing live telephone consultation services for physicians in widely 
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scattered rural and semi-rural communities and their hospitals. Called 
MIST, this project is reported to have served over 900 consultations re- 
quests from all parts of the state in a six month period, iirowti and Uhl 
(32) report that both community physicians and faculty have found the 
system both feasible and useful. 
Correspondence; Programmed Inst:ructxcn; 

In 1962 the journal Spectrum published an article on programmed 
learning along with a prograimned sequence on how to read an electro- 
cardiogram on myocardial infarction. The issue was circulated to 225, 
000 physicians in the Unitef^ States, of whom 50,000 replied with a 
"blanket endorsement of the program." As a rresult, a longer program 
on allergy and hypersensitivity was made available to physicians on 
request. Balson (18) reports tSiat ttSs prograai is in use in 81.3% 
of the AmerjLcan medical schools* 

In 1964, Spiegel (234) xreported a subjiective evaluation of a 
course on Diabetes Control taught by 'programmed instruction on a teach- 
ing machine* Of the 78 physicians who completed the course, all felt 
it was a meaningful program. In comparing this device with other ed- 
ucational techniques , the physicians strongly endoi^ed the teaching 
machine approach. On the basis of post program interviews and follow- 
up mail questionnaires; it was estimated that two thirds to three 
quarters of the sihyslcians who completed the program have modified, or 
will modify, th^r diagnostic and/or treatment prat^lces with diabetes 
as a result of having participated lit idae coiirse. Programmed instruction 
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like correspondence studies, appea\;^j. to have found its greatest ucie as 
a supplementary device used in conjunction with other forms of instruc- 
tion (54, 59, 61). 
Computer Assisted Instruction : 

Computer assisted instruction (CAI) in medical education is still 
in its infancy. Paxton (180) reports that a number of diversified medi- 
cal cases have been computer programmed by the University of Illinois. 
A physician with an interesting case can question, the computer in his 
own words and the imaginative programming enables the computer to pick 
out key words in the doctor's statement for which it then provides the 
the appropriate answer. Also under development are several computerized 
self-testing programs « Although these are still experimental, it is 
planned that they will be expanded to include continuing education hook- 
ups with some outlying hospitals. 

Ohio State University has some tutorial evaluation programs 
routinely available to medical students and by telephone lines to phy- 
sicians in ten area hospitals. The equipment is less elaborate in that 
it uses teletypewriter terminals instead of TV display screens. The 
teleprinter is augmented by a slide projector with coloured slides and 
the computer instructs the utser iihen to view a particular slide. The 
learner takes as long as he likes to examine it then types the response 
called for by the program* 

The University of Oklahoma tested a variety of computerized 
teaching programs between 1965 and 1968 « Harless et al (110) report 
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the findings of one study involving fourteen practising physicians who 
attended a one week course in clinical anesthesiology in which a one 
hour CAI lesson- was included. Data showed that the physicians' atti- 
tudes toward CAI. educational television, and progratmned instruction 
texts were comparable before exposure to CAI. After the CAI lesson, 
attitudes toward CAI were significantly more positive than were atti- 
tudes towards either educational television or programmed instruction. 

At the University of Southern California, Abrahamson et al (3) 
have produced a computerized learning aid called Sim One which is a 
realistic mannequin upon x^hich physicians may learn how to carry out 
endotracheal intubation. The computer is programmed so that the manne- 
quin reacts physiologically to various drugs or treatments which may 
be administered. Continuous graphic displays .show the changes in blood 
pressure, pulse rate, etc., thereby depicting the mannequin's responses 
to treatment. Wires run from strategically placed magnets and sensors 
in Sim One through a large cable to the computer and to the instructor 
at a control console through which the instructor is kept posted on 
the physician^s progress in learning. In one study of skill acquisition, 
the learning rate of ten new anesthesiology residents was compared. 
Five. of these experienced conventional instruction and five learned the 
technique using the mannequin. Findings revealed that those who used 
Sim One took an average of 30 attempts over a period of 45.6 days to 
achieve nine out of ten professionally competent intubations as compared 
with 60 attempts in 77 days for the control group. There are plans to 
develop refinements of Sim One for teaching other specific techniques to 
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medical and paramedical workers. Pa-^iton (180) indicates that the Sims 
"can shorten the t?-me required to teach manual procedures in almost 
every phase of medicine." 

Allen and Ottem (5) report three experimental programs utilizing 
audio response computer services. One is a drug compatability program 
in which the input is a pair of drug codes and the output one of four 
compatabilities: "yes", "no", "conditional", or "unknown." The second 
program is a bum formula program which calculates the proper initial 
quantities of electrolytes and fluid required in treatment. The third 
is a symptom diagnosis program that is augmented by diagnostic data in 
the literature. 

A similar but more sophisticated computer program is reported 
in operation at the University of Missouri. This program, called 
Consider uses cathode ray tube (T.V.) input-output terminals. The - 
major weakness is the absence of printed output which could be required 
for legal reasons or for a patient's record. 

The cost of these programs is reported as reasonable. Allen and 

Ottem (5) estimate that: 

The intravenous additive program costs under 35 cents for each 
run plus $10 per month for program and data storage. The bum 
formula program which is purely computational, costs roughly 
50 cents per use plus $1 per month for required storage. The 
diagnostic assistance program costs about 40 cents per calcu- 
lation plus $2 per month for storage. 

They suggest a feature which would greatly improve computer pro- 
grams : 

Access to data bases from various authorities for controversial 
subject areas • This feature would give a computer network some 
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of the flexibility now offered to the physician by having 
several medical textbooks, journal articles, and scientific 
documents available on particular topics. 

ORGANIZATION FOR INSTRUCTIONAL TECHNOLOGY 

A number of recent articles provide evidence of attempts to 
create proper facilities and environments for the effective use of mass 
media in continuing medical education. Also being discussed and imple- 
mented are centralized systems to expedite the de^/elopment and dis- 
tribution of instructional materials and devices on both regional and 
national levels. 
Regional : 

In 1959 the University of Utah developed an Audio-Visual Kit' 
which could be shipped to physicians in rural communities. Contained 
in the kit were medical discussions on long play records, accompanying 
* .scripts, and coloured slides. This mail service proved successful so 
other organizations developed similar programs (232). The University 
of British Columbia is developing a Mobile Van Service (164) to pro- 
vide a multi-media approach to continuing education for physicians and 
members of the allied health professions in British Columbia, particularly 
those who find it difficult to leave their practices*' 

The Alaska/Washington RMP is developing a unit which will produce 
and co-ordinate all educationa:! materials for projects in thfe two state 
region. It is anticipated that greater efficiency will be achieved 
and considerable money saved by centralized production. More partic- 
ularly* however, the main emphasis of this unit will be to "provide up 
ER|C <^ date information to the more isolated rural physician by way of 
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modern connnuTiications technology (138) . 

Cooper (63) reports the establishment of an Office of Audio- 
Visual Education in the Health Sciences Center at the University of 
Colorado. With the University's multi-disciplinary student laboratories 
(unit teaching laboratories), and the newly constructed Office of Researc 
in Health Science Education, it will serve as a central source for pro- 
duction, distribution, and evaluation of multimedia programs for the 
Colorado/Wyoming RMP. Among the many educational approaches which have 
been explored, two proposed pilot projects are of particular interest. 
The first is a videotape exchange program among hospitals within the 
Cc'lorado/Wyoming region whereby videotape recordings made by the clinical 
staff of hospitals xjill be exchanged on a weekly basis. The second will 
be the production of a series of single-concept films and filmstrips on 
oral cancer, the audio portions of which will be capable of alteration in 
such a way that the same films and filmstrips will serve dental hygenists 
nurses, physicians dentists, or patients. 

The University of Saskatchewan (13) has decided that its major 
focus for the next several years will be on the development and promotion 
of improved "Information Retrieval" methods, and a four stage program has 
been outlined: 1) to assist community hospitals in their efforts to pro- 
vide improved library facilities; 2) to encourage and assist physicians 
in the improvement and expansion of direct telephone consultations, 3) 
to establish Dial Access Telephone Library, facilities ; and 4) to assist 
base libraries in their efforts to provide rapid and efficient subject 
and bibliographic retrieval by both manual and automated means. Efforts 
to develop each phase are proceeding simultaneously. 
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in the Albany mp . co^nlty hospitals are being developed as pro- 
totype learning centers for the use of newer Instructional technology. 
These are being set up In three sizes: t::.. „.,,Uest are for hospitals 
with staffs of up, to twenty doctors a.,:. ...,.„.re sound tapes, telephone 
dial access programs, radio receivers wh.ch will allow two-way radio 
conferences, and other related visual materials. The medlun, sized cen- 
ters for hospitals of fro., twenty to fifty physicians will Include In 
addition the medical Jukebox. The largest hospitals will have videotape 
projectors as well. These learning centers are being established either 
as an Integral part of the medical library or are located adjacent to a 
library and are under the continuous supervision of library personnel. 
According to Woolsey . (277) , 

Medical libraries can no loneer ^.vIqV h,.o«- * 

retrieval of printed inforaafion? t storing and 

librarian should be on ha^^ « / . ""^^^^^ ^ medical 

you need is not i^edL^^^y "aSaM^ "-"l^ant. If what 

It out quickly or thf i^plLe^^^o^^^^^n ^ay be'l^lj?" 

Similarly, Castle (41) reports that the Inter-n.ountain RMP staff 
have helped to organize the following learning resources in the .ajor 
community hospitals: 

conference Room Kgutpp., ,.„,^, Established 

Usual teaching aids 

Audio playback 

Television playback facilities 

'^^'^7 Connection with the 'University " 
Medical Center ^ 

Medical Library and Exchange 'system wi^h 
University Resources 

^''t^ilfJ^^^^^'f ""^"^^^ s;;tei;;*i;t;g;;;;i"" 

with Educational Programs (PAS MAP) .... o 

"^^^^sj Education Co-ordination, or Core " * 

acu ty .. ^ 
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National : 

As the various medical centers became increasingly involved in 
producing programs for television, the need for a centralized agency to 
co-ordinate programs and film exchanges has culminated In the establish- 
ment of a National Association of Medical Television Broadcasters in 
1965 with headquarters in Utah. The objectives of the Association are: 
1) to promote the use of broadcast television as a medium for continuing 
education, and 2) encourage wider co-operation in program planning, pro- 
duction, and distribution. At the moment, videotapes are readily avail- 
able through the services of this Association (AMTVB) and according to 
Brayton et al (29) , "any medical school or organization having access 
to an ETV station or link up with such stations can. now initiate its 
own postgraduate medical television broadcast series at minimal cost.'" 

The National Medical Audiovisual Center (NMAC) in Atlanta, 
Georgia, lends more than 93,000 audiovisual items each year to members 
of the health professions. The Center is said to have the world's 
largest medical audiovisual collection* In addition, the NMAC produces 
all types of audiovisual materials for health professions and serves as 
an international clearinghouse for biomedical audiovisual information 
(172). 

The Medical Literature Analysis and Retrieval System (MEDLARS) 
is a computerized bibliographic system developed by the National Library 
of Medicine. In use since 1964, this system indexes the major medical 
journals using a computer to store the information* Index Medicus is 
printed directly from the computer > thus by scanning the subject section 
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of this listing, a searcher may determine whether his field of interest 

is adequately covered by MEDLARS. If so, MEDLARS will retrieve the 

literature relevant to his specific request • Lancaster (136) reports that 

"over 3»000 demand searches are now formulated annually at the National 

Library of Medicine. Additional searches are being handled at regional 

MEDLARS centers in the United States, the United Kingdom, Sweden, and 

more recently in Canada." Although not without its limitations, MEDLARS 

offers the most extensive and quickest indexing service presently avail-- 

able on medical literature. 

The Interuniversity Communications Council (EDUCOM) was organized 

in 1965. It represents not only the health professions, but also a variety 

of university disciplines equally interested in developing and sharing 

resources in higher education. Although beginning with representatives 

from eight universities. Miller (162) reported eighty-eight participating 

universities in 1968. Future plans of this organization include the 

development of a multimedia electronic network which will facilitate 

sharing of resources and accelerate information processing. In medicine 

this will provide rapid access to specialists when their advice is 

needed. The four criteria followed in developing the network are: 

That it be interdisciplinary for all fields and not only 
for the health sciences. 

That its services be available everywhere in the United 
States, and eventually, by extension, everyvrhere in the 
world. 

That it be a multimedium network, not limited to computers 
or facsimile transmission of documents or television or 
computerized program instruction, but Including all media 
of educational value which can be put on an electronic net- 
work. 

That whenever feasible, all materials be available rapidly 
on demand, when desired by the user. 
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CHAPTER V 
EVALUATION 

Since the primary objective of continuing education in mediciaae 
is the achievement of learning that will result In improved patient caxe 
it is necessary to evaluate program activities • As Abrahamson (2) has 
stated y evaluation is a "continuous process based upon criteria co- 
operatively developed » and is concerned with the status of, and changes, 
in behavior of the learners." In theses terms, evaluation has not been 
an integral part of continuing education in medicine although it is now 
becoming a matter of concern. There has been an increase in the number 
of evaluation studies found in the literature over the past few years 
but most of these suffer from inadequate design and measurement so that 
the results achieved are largely inconclusive. Such evaluation as has 
been reported is principally subjective but there is a promising in- 
crease in attempts at the objective assessment of learning. 

SUBJECTIVE ASSESSMENT 

_ Next to attendance records, the most commonly reported form of 

evaluation is the follow up questionnaire which solicits participant 
opinion with regard to a program (2, 220, 241). The information usually 
sought includes why physicians attended, thelir impressions and opinions 
with respect to various aspects of the program, and whether they felt 
they achieved their objectives. Since these instruments solicit unver- 
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Ifled subjective opinions about an educational event they are oftsn 
referred to as a "hapiiiess index" or opiLnionnaire. While such instru- 
ments may be useful in planning future courses, they provide no evidence 
that learning really occurred. Donnelly and Natfulin (77) report an 
experiment which illustrates this point: 

We recently conducted a somewhait^ -limited study of the validity 
of the so-called happiness index.. An actor was hired and pro- 
grammed to speak incoherently on a topic of interest to medical 
educators. « .His name, erroneous titles, and degrees were included 
on the program seminar. He gave a highly technical presentation 
which consisted of nothing more than mere double talk. He spoke 
on a subject about which he knew nothing. An analysis of the sub- 
stance of his presentation indicated that it consisted primarily 
of unrelated examples and a few good jokes. Following this very 
"entertaining" lecture, the audience (consisting primarily of 
instructors. ..) was administered a replica of one of the hapiness 
questionnaires. . .Without exception the group rated the lecture 
and ensuing question and answer period highly in every respect. 
They found it interesting, informative, and stimulating... 

In other words, the liedical educators in attendance were very 
happy with the instructional experience despite the fact that the pro- 
grammers had minimized the learning component. While this is obviously 
an extreme example, most writers agree that it is not sufficient to con- 
sider a program successful simply "because attendance is high and com- 
plaints are low" (27). More recently, various modifications of the 
happiness index have been reported. Levinson (140) evaluates his one- 
week health seminars by having participants rate each lecture and all 
other aspects of the seminar on a five-point scale. They are also asked 
to comment freely about the experience and to add additional comments to 
the evaluation sheet at the end of the week. Six months later, through 
a mail questionnaire, each participant is again asked to evaluate the 
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experience. This :::.lme iis is a^^ked what he thinks he learned at the 
seminar that was mast, *Uueful to him, what was least useful, how he 
applied what he learned and vihat problems he had in their application. 
Although Levinson ±3 net entixsiy satisfied with this procedure of eval- 
uation, he reports <:oias3Cxuctl^!esE feedback and specific examples of changes 
in medical practice i^idash phy fftc tans have attributed to course attendance* 

From the field of public health, Parlette (179) reports experi- 
mental studies using paired questionnaires, one answered by the partic- 
ipant concerning change In himself as he perceives it, and the other, 
by his superior. The hypothesis is, "that the deeper the Individual 
insights are, the more likely change will occur and be recognized by 
his superiors and therefore the participant's reported change is more 
valid." 

Another variation of the opinionnaire is the use of a personal 
interview with small randomly selected groups of participants prior to 
and following each session of the program. Meyer is quoted by Vaneslow 
(25A) as saying that "this technique is exceedingly useful in eliciting 
pertinent and candid comments from participants." 

Dohner et_ al, (75) devised an instrument which can be used as an 
index of the effectiveness of short courses. This is a motivation scale, 
consisting of a set of bi-polar adjectives designed to assess the degree 
of enthusiasm or motivation as Judged by the learners' perceptions of 
the general value and relevance' of course objectives and content in 
meeting their learning needs. Evidence of the reliability of the instru- 
ment was provided hy ccorrellatlng each scored Item on the scale with 
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participants' questionnaire responses. Although the results from one pre- 
liminary study indicate that the scale with further refinement could pro- 
vide a valid instrument , the extent to which the scale predicts changes 
that actually occur In a participant's subsequent behavior has yet to be 
validated . 

Although the "happiness index" or opinionnaire has no validity 
or reliability it is exceedingly popular with program directors even 
though it is of no real value as a judgement on a program. It would be 
advantageous if all of those in continuing medical education could work 
together to develop some standard objective instruments to assess opinions 
about their programs. This could be done with less trouble and expense 
than is now wasted individually on invalid subjective measures • 

OBJECTIVE EVALUATION 

The use of objective measures for evaluation is increasing. Such 
measures can provide hard data to assess whether programs are achieving 
their objectives and enable program planners to work with greater security 
that the evaluation has some validity. Objective instruments have been 
constructed to measure specific content material acquired » attitude devel- 
opment or change^ feelings about instructional activities » job performance,, 
and pa':ient care. 

Testing for the Achievement of Learning ; 

The pre- and post- design using paper and pencil tests has become 
fairly common in continuing medical education • A number of writers con- 
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sider that the practice is reasonably well accepted by physicians (24A) 
(271) . Since most of these tests are teacher-made and based on specific 
information the practitioners are expected to learn, the results in no 
way identify what the physicians actually do learn. Furthermore, studies 
have found that neither knowledge gain nor satisfaction necessarily en-- 
sure desirable changes in behavior. 

An evaluation of an intensive psychiatric and neurology review 
course reported by Natfulin and Ware (170) is interesting in this re- 
gard • In this study, the experimental population consisted of twenty- 
two psychiatrists enrolled in a program. Twelve of the group were studying 
for specialty board examinations while another ten constituted a control 
group who were studying for certification through traditional self-study 
methods. The four evaluation techniques used were: 1) simulated American 
Board examinations; 2) multiple choice examinations; 3) interviews; and 
4) satisfaction questionnaires. As hypothesiaed, those in the course 
passed the board examinations at a proportionately higher rate than did 
the controls, and expressed a higher level of satisfaction with their 
board preparation. There was no significant change in the mean scores 
for those board examiners and experts who also took the tests. On 
the basis of these findings, these researchers conclude; 

While the debate over peer review, mandatory continuing ed- 
ucation, re-certification, and serial certification programs 
become hotter, medical education must develop more effective 
evaluation of the relationships among continuing education, 
specialty skills, and clinical competence. If continuing ed- 
ucation interests correlate with clinical needs in both: geo^^ 
graphic and specialty areas of medical practice^ more agrees 
ment may be reached as to what clinical competence Is. . • 
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In this respect. Miller (161) identified the critical components 
of clinical competence pertaining to orthopedics through an analysis of 
over 1,700 critical incidents contributed by practising orthopedists. 
Since these competencies are relevant to most areas of medicine, and 
with additional refinement could be used as the basis for defining measur 
able behavioral objectives in most fields of practice, they are re-stated 
here : 

,1, Skill in gathering clinical information: 

a. Eliciting historical information 

b. Obtaining information by physical examination 

2. Effectiveness in using special diagnostic methods: 

a. Obtaining and interpreting x^ray films 

b. Obtaining additional information by other means 

3. Competence in developing a diagnosis: 

a. Approaching diagnosis objectively 

b. Recognizing conditions 

4. Judgement in deciding on appropriate care: 

a. Adapting treatment to individual cases 

b. Determining extent and immediacy of therapeutic needs 

5. Judgement and skill in implementing treatment: 

a. Planning the operation 

b. Making necessary preparations for operation 

c. Modifying operative plans according to situation 

6. Effectiveness in treating emergency patients: 

a. Handling patients 

b. Performing emergency treatment 

7* Competence in providing continuing care: 

a. Attention postoperatively 

b. Monitoring patient's progress 

8. Effectiveness of physician-patient relationships: 
a. Showing concern and consideration 

b» Relieving anxiety of patient and family 

9. Accepting responsibility for the welfare of the patient: 

a. Recognizing professional capabilities and limitations 

b. Relating effectively to other medical persons 
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Using this scheme. Miller and his colleagues then undertook a 
sjPistematic review of both the oral and written parts of certifying exam- 
inations for the American Board of Orthopedic Surgeons. This study 
reveeiled that tests in both subject matter and professional skills were 
incomplete and spotty. Accordingly, a new certification program was 
developed using these defined competencies as the basis for test con- 
struction. 

The study by McGuire and colleagues (149) illustrates another 
well known problem of educational testing, namely: that loss of skills 
almost always occurs unless periodic reinforcement is provided to main- 
tain the skill. Using one control and four experimental groups of 30 
to 40 physicians, the study sought to determine gain and retention of 
auscultatory skills in physicians following a twelve to twenty hour 
intensive course. Prior to instruction, both the control and experi^ 
mental groups were pre-tested on the identification of fifteen unknown 
heart sounds. Immediately following the instructional program, the 
four experimental groups were re-tested. At this time, a review of 
hospital charts was undertaken for the control group and one experi-* 
mental group to assess the information recorded on patients hospital- 
ized with cardio-vascular problems. On the test administered immediately 
following thf5 course, the experimental groups showed statistically sig- 
nificant gains compared to the control group. At six months, however j 
the mean scores were not significantly different from the mean score of 
the pre-test. Moreover, chart reviews of both the controls and experi- 
mental groups showed ho significant difference in the recording of 
cardiac findings. 
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Richardson (201) , using a study similar in design to that of 
the McGulre group, was able to demonstrate some aiiscultatory skill re- 
tention with two groups of physicians (N==16 and 15) , and with a third 
group, (N=15) , a mean gain of from 6.4 to 12 six months after training. 
He attributes these differential findings to the intermittent training 
schedule used in his study as compared with the intensive one session 
course provided in the McGuire study. 

A number of exploratory studies using the pre and post test 
design to measure attitude change are reported from the field of psy- 
chiatry. Zabarenko (281) concluded that ''the results are tantalizingly 
suggestive but far from coherent." Tucker et al^ (249) in a longitudinal 
study of 219 volunteer flight surgeons used scaled questionnaires to 
measure attitude change following a six month postgraduate course con-- 
sisting of 48 lectures and eight three-hour interviewing sessions. The 
quest ionnaireSy administered at the beginning and at the completion of 
the course, and again eighteen months later, were designed to elicit 
responses to some 44 frequently heard statements about psychiatry which 
were scored on a four point scale. The criteria used to score the re- 
sponses were established by four independent psychiatrists. The most 
significant findings were that "while the physicians' attitudes toward 
psychiatrists, psychotherapy and mental illness changed very little 
over time 9 they felt more confident and competent in treating psychiatric 
patients." These findings represent a sampling of opinions and attitudes 
of a group of student flight surgeons with regards to certain statements 
about psychiatry, and in no way provide conclusive evidence that any be- 
ERJCrloral change occurred which was attributable to course attendance. 
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Pearson (181) used four specially devised scales to evaluate 
eight short term psychiatric seminars for general practitioners in 
eight different communities. Sponsored by WICHE, the programs were 
all similar in format and used mainly a non-directive approach. The 
scales used were designed to measure; 1) role tolerance ^ 2) psychiatric 
orientation, 3) apostolic function, and 4) social distance. The crit- 
eria used to score the scale were the scores achieved by the psychiatrist 
instructors. The scales were administered as pre- and post-tests to a 
total of 79 physicians. Although the finding were somewhat varied on 
the individual scales, statistically significant relationships were found 
between one or more scales and, on the basis of this, these researchers 
conclude that the course achieved "attitude change in the desired direc- 



On the other hand, Chassy and Heslin (181) > using a similar re- 
search design, were unable to confirm attitude change in their study of 
79 general practitioners tf ho had attended another ten WICHE seminars. 
Commenting on these studies. Smith (181) states: 

To decide seminar goals Is a difficult enough matter but to 
decide in an objective fashion whether the goals have been 
achieved is in my judgement, considerably more difficult. 
Perhaps the most satisfactory means of evaluation is via ob- 
jective measuring instruments. However laudable the evaluation 
efforts of my WICHE colleagues have been In this direction, 
they are the first to admit that their attempts have a strong 
element of superficiality In them. Can a questionnaire ever 
be devised to Indicate that a physician is more psychologically 
minded, has mere human understanding, and has the therapeutic 
ability to help his patient toward further understanding of 
himself? I feel that these are extremely difficult things to 
measure and to assess. 
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Forman and his co-workers (100) attempted to test attitude change 
following short term psychiatric seminars utilizing tape recorded sim- 
ulated patient interviews. As a pre-test the physicians (six in one test 
situation and 17 in the other) were required to answer questions related 
to these interviews. This procedure was repeated at the end of the course 
and the results of the two tests were compared. The same recordings and 
questionnaires were also presented to the criterion group consisting of 
psychiatric resident and staff physicians. Although it was felt that a 
fair degree of change occurred in the understanding of and Interest in 
psychiatry, the results were Inconclusive as measured against the crit- 
erion group. 

Enelow and Adler (89) have defined goals more clearly, and In 
spite of a limited sample, they report more conclusive results. In one 
study (90) designed to measure the effectiveness of a series of ten psy- 
chiatric case conferences in producing cognitive learning gain, a before 
and after design was used that employed instructed responses to three 
films of simulated interviews. The responses of the psychiatrist In- 
structors provided the criteria against which the fourteen participating 
physicians were rated. Of the three major hypotheses testing attainment 
of the stated objectives, two were substantiated at better than an .05 

level of significance. 

Another study reported by Enelow and Adler (87) concerned atti- 
tude change following an advanced supervisory psychotherapy course con- 
sisting of 32 four hour session. Four Guttman scales were used to 
measure the four dimensions of the physician *s role in the doctor-patient 
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relationship (authority; self -involvement ; expression of concern; and 
instrumental). These were administered to six physicians before and 
at the end of the course • A comparison of the two sets of scores re- 
vealed that during the course the physicians' conception of the doctor^ 
piitient relationship became more consistent in support, taoderate in 
reliance on technical procedures, and high in self-involvement . A 
follow up interviel^T undertaken several years later revealed that all 
six physicians had changed their style of interviewing patients, with 
more emphasis on the patient's behavior and less dependency on psy- 
chotropic drugs and psychiatric referrals. Enelow and Myers (91) note 
that "change in attitude and practice will occur for physicians who 
take two or three years of psychiatric courses culminating in the ad- 
vanced supervised psychotherapy course." 
Measuring Change In Performance : 

Belkin et^ ail (21) attempted to assess the effects of a short 
training program designed to assist the staff of the Child Health 
Station in New York City to Integrate mental health principles Itito 
their dally practice. Using a before and after experimental design, 
48 participating physicians were randomly assigned to an experimental 
and to a control group. The experimental group was observed and scored 
in detail by two different observers prior to the course and again one 
month after completing training. The control group, which had not gone 
through the program, was similarly observed. In order to validate the 
Instrument, observers were not told whether the doctor being observed 
was in the experimental or control group , and the doctors v^re not told 
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why the observers were present. The series of observations of perform- 
ance and questionnaire responses Indicated that while the training pro- 
gram was relatively successful in instilling a knowledge of mental health 
principles and techniques of counselling, a comparison of experimental 
and control groups suggested that the program was less successful in al- 
tering physicians' behavior in practice. 

Roney and Roark (212) used patient records as the primary source 
of data to evaluate the effectiveness of a circuit course. The sample 
consisted of 1,092 patient records of 41 practising physicians, 24 of 
whom had attended one or more sessions of the course. The physicians 
were asked to respond to statements concerning 12 health problems that 
reflected the content of the course being studied. They also selected 
procedures pertinent to the management of these health problems from 
their medical records. The use of these procedures as indicated by the 
patient records was then compared for participants and non-participants 
both before snd after the course. Both groups gave correct responses 
to the questionnaire and although the findings suggested that physicians 
attending the course were somewhat more competent in the management of 
selected health problems indicated by patient records, the difference 
between the two groups was not statistically significant, 

Foster and Lass (102) also used patient records as a source of 
data to evaluate a videotaped program on the use of diuretics. Two 
matched hospitals were used> one serving as the experimental and the 
other as the control group. Observations were made of patient records 
In both hospitals for three weeks prior to and three weeks following 
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the showing of the videotape in the experimental hospital. The infor- 
mation sought was the extent to which there would be an increase in serum 
potassium and sodium determinations in the experimental hospital as a 
result of the videotaped program. The analysis of patient records found 
no significant differences* The data did reveal that physicians In the 
experimental hospital were functioning at a significantly higher level 
than the control group prior to the program. Accordingly, as noted by 
Abrahamson ([1) , "One can say that the objectives for using that program 
were inappropriate. . .inappropriate certainly for the practice needs of 
those physicians." 

Measuring Long Term Results of Care; 

While the ultimate goal of all continuing medical education is 
the improvement of medical care, efforts to establish cause-effect re- 
lationships have pro\.?n both difficult and disappointing. One early 
attempt was a study by Peterson and others (185) of 94 general practi- 
tioners. They observed and rated the quality of medical care being 
practised and then assessed the qualitative rankings against the number 
of hours of continuing education per physician per year. Some of the 
superior physicians in this study were found to have taken little con^^ 
tlnuing education while some of the poorest were frequent participants. 
This suggests that there was little relationship between the quality of 
care and participation in continuing medical education. 

A more recent study (141) disclosed similar findings « Utilizing 
an epidemiological approach, this statewide survey attempted to relate 
physician participation in continuing medical education to 1) reduced 
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maternal and perinatal deaths, and 2) physicians' use of certain sur- 
gical procedures. Findings revealed that no such relationship existed. 
In fact, maternal death rates were highest in two regions with the high- 
est physician participation in obstetrical programs of continuing ed- 
ucation and lowest in the regions where physicians took the fewest hours 
of study. Moreover, in the two regions with the highest tonsillectomy 
rates, physicians attended no postgraduate course on otolaryngology 
during the ten year period under study. 

In a two year study Korchln (133) sought to determine whether 
an extensive physician education program would appreciably alter attit- 
udes and improve practice in relation to the medical management and 
control of rheumatic fever. In this project, 100 physicians in one 
county served as the experimental group and were offered a variety of 
educational offerings during the course of one year, while 50 physicians 
in a second county earved as the control group and were offered no extra 
learning opportunities. Data per tl. ant to physicians' medical knowledge 
and practice with regards to rheumatic fever was obtained by the use of 
before and after interviews in the two counties and the differential 
responses scored and compared. 

Without belaboring the obvious limitations of the research . 
design, two findings of this study are worth reporting: 1) those phy- 
sicians who were already practising medicine at a high level were more 
favorably inclined toward the educational programs and to public health 
measures in general, and 2) in both counties, physicians' medical know- 
ledge regarding the diagnosis and control of rheumatic fever vas high. 
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but their use of laboratory methods to confirm diagnosis and their use 
of prophylactic drugs was inadequate. In short, the application of 
what the physician already knew seemed indicated. Others reporting 
similar findings were Tabennaus (2A4). Peterson et al (185), and Clute 
(46). Indeed, in Clute 's study, a higher percentage of physicians who 
said it "was not particularly difficult to keep up in medicine, were 
practising a low calibre of medical care." Commenting on this finding, 
Lewis and Hussanein (141) ask: "How can physicians judge their need 
for continuing education, if they are not even aware of their own limit- 
ations as practitioners?" 
Program Models for Built In Evaluation ; 

Varying from these approaches have been several recent attempts 
to help physicians identify their own deficiencies based on patient care 
research, and then to evaluate the effect of educational efforts designed 
to help overcome these deficiencies. The first study using this approach 
was that reported by Williamson and his group (272). The purpose of this 
pilot project, was to: 

1) Measure physicians' responses to abnormal and unexpected 
results of three routine admission tests (evaluation); 2) 
. determine whether the physicians needed to Improve their re- 

sponses (objectives); 3) provide the required education 
(instruction); and 4) re-assess responses to these screening 
tests and evaluating and repeating the cycle as many times 
as required to achieve and measure the desired level of pro- 
ficiency. 

Initial assessment was accomplished by means of a chart review 
and since it revealed that approximately two-thirds of the unexpected 
abnormal test results went unheeded, a workshop was held to discuss 
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the findings. Although a subjective evaluation of the conference in- 
dicated that the physicians found it stimulating and xnf onnative, 
follow up chart reviews disclosed continued neglect of laboratory 
reports. Accordingly , the educational approach was changed with 
efforts directed toward altering the physicians' behavior patterns. 
Removable fluorescent tape was used to obscure abnormal data on the 
laboratory reports and this resulted in a significant improvement in 
the physicians' response to test results. This change in behavior 
was maintained by more than one half of the participants, six months 
after the use of the tape was discontinued. 

In the second phase of the project, Williamson's group (271) 
demonstrated a method for identifying areas requiring priority atten- 
tion as disclosed by patient care research. The method consisted of 
three steps: 1) ranking each medical condition encountered at the 
hospital according to expected patient disabilities; 2) determine 
which were preventable or treatable in the light of current medical 
knowledge; and then, 3) assessing the extent to which current medical 
knowledge was being applied with regards to these conditiisms • The 
application of this priority system resulted in the Identriflcation 
of six top ranking health problems which then provided d±rcbCtion for 
the development of the continuing education program of the ooiedical 
staff* 

Using an elaboration of the Cybernetic model (see Table IV) 
Brown and his colleagues (32) at Chestnut Hill community hospital 
have conducted several pilot projects with good resulta. In one 
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study, ten top jLiBgK^„f rns: diseases were identified and the hospital staff 
involved In develoc{z£sig criteria of performance, in the management: of 
these high priority diseases • Using these criteria in conjunction 
with chart reviews of patient follow ups. Brown and his group have 
been able to demonstrate the value of this approach in arriving at 
precise objectives whereby educational efforts may be measured in 
behavioral terms. To illustrate, they report an investigation con- 
ducted in the use of Antibiotics: 

From studies of those health problems which the system of 
priority indicated as offering significant potentialities 
for Improving patient care, it became evident that since 
in one medical department a review of fifty consecutive 
records of patients revealed only a thirty percent correct 
usage of antibiotics, a program was required to correct 
the educational deficit. 

To further determine whether the educational deficit was an 
informational or problem solving deficiency, an examination based on 
sixteen of the cases reviewed was taken by 42 members of the depart- 
ment studied.. The tesst: results InfHfoated that the physicians had 
adequate knowledge, iss^^our conferensies were held in. which the phy- 
sicians discussed pa^trdient: management with experts and appropriate 
literature was Intradfoced as necesrary. A follow up study on the 
petformnce of phy ^Ibiaaia s, using ch a r t reviews and data from the 
pharmacy, revealed changes: in drug usb: and management practices con- 
sistent with the b^oavsissiral change desired. 

In a modification of this approach, (237) a group of experts 
from across the nation developed a criterion of performance for the 
^ top ranking health problems. A number of Simulated Patient Problems 
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were then devised based on these priority health problems which en- 
abled a physician to test his o«n performance so as to Identify 
deficiencies which could serve as the basis for planning and evaluating 
programs of continuing medical education. 

Another program model which attempts to provide Individual 
instruction according to objectively Identified deficiencies of prac- 
tlslng physicians Is the Physicians' Profile Project In operation at 
the university of Wisconsin. The procedure In this case was to: 1) 
gather data pertinent to the physician's practice, 2) test the phy- 
sician m the major areas of his practice; 3) provide educational con- 
sultation and study relevant to his practice profile, test the results; 
and then 4) provide for subsequent re-profillng and testing as a form 
of program evaluation. In the study reported, a medical secretary 
Visited the offices of 37 volunteer physicians for a one-week period, 
collecting patient data which was coded to j,rovlde each .physician 
With a practice profile. The physicians were then tested through the 
use of multiple choice examinations based on their profiles. For 
convenience, tests were administered by way of portable teletype equip- 
ment linked to the Univerelty of Wisconsin Computer Center. Educational 
consultants from the medical center then met with each pl,sl=ia„ to 
plan a program of study related to the physician's profile and test 
results. Although this study disclosed that the testing procedures 
required refinement, and the overall program reduced in costs, the 
approach was feasible, and the continuation of the project was rec- 
^onimended . 
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SOURCE: Brown, C., 'and H. Uhl, ''Mandatory Continuing Education: Sense or 
Nonsense?"^ JAMA ; 23:1663 (September » 1970). 
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PROBLEMS OF EVALUATION 

The research reports that have been concerned with the eval- 
uation of programs in continuing medical education 'suffer from major 
deficiencies that are slowly gaining recognition. Although virtually 
everyone concerned with continuing education agrees that evaluation 
is a good thing, there is no general awareness nor acceptance of the 
importance of maintaining ordinary srivpnrrlfic controls in conducting 
evaluations. Too many seem to be content with casual and unsystematic 
opinionnalases that have neither validity nor reliability in preference 
to the mor& difficult and rigorous scientific approach to evaluation 
that can ^provide usable data. This reluctance may stem, in part, from 
the problsamLof identifying precise instructional objectives and, in 
part, fraim"::the problem of constructing, adequate research designs and 
instruments.- 

The Problem:: of Objectives 

As :noted earlier, there have been numerous surveys attempting 
to define the general interests and felt learning needs of physicians. 
More recently, self-assessment tests have become Increasingly popular 
as a way of helping practitioners identify their own learning needs; 
At the community level, several RMP have conducted consumer surveys 
in an attempt to identify the health needs of the community (108, 252), 
While useful, as stated by Miller (160), "These types of efforts in 
isolation do not necessarily Identify the real learning needs." More- 
over, equally apparent in most of the studies reported, the the pre- 
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valence of vaguely defined objectives which are not readily translated 
into measurable terms » or which are unrealistic in relatrion txo reason- 
able expectations of achievement. 

Too many programs attempt faar too much for tte: time: ^v^Llable, 
so that the objectives are global rather than specific. Vagmeiy con- 
ceptualized objectives provide no critreria against which to naeasure 
results:; consequently, in order to evsalinate continuing medinail education 
the objectives must be stated explidttly in measurable terms and the 
programs limited to those objectives. 
Deaign Problems : 

An obvious weakness of evfr1hiBr"tigm studies is "the ±nadequacy 
of the research designs. Most stud3?es ^suffer from problems of irontrol 
such as inadequate sample size, temporal change in educatliona^L outcomes, 
problems of measurement, and experimenter-participant ciamstraimts , to 
name but a few. 

Although attention has focuss:edi:.recently on the SHEtzsessful pro- 
gram evaluations reported by Williamson and Brown, using tfeiimedical 
audit » as warned by Vaneslow (254), *'One could argue that each succeeded 
largely because of the personal charisma of the individual, in charge, 
and that it would be dangerous to assume that equal success could be 
anticipated in other settings." Moreover, since most care Is not given 
±n the hospital but in the physician's office, the use of such a method 
would need to include an audit of the physician's office practice as 
well (62). Even more Importantly, as pointed out In the recent Confer^ 
enceon Evaluation (49) , 
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We have been discussing the medical tangibles, pneumonia, Idas 
capacity to handle the acute coronary, or whatever you will.. 
What about insights into the emotional areas? No just psy- 
chiatry but emotion in relation to illness, in relation to 
life and deatiau^. • the kind of things that we do not really se© 
even in the records .. .These are the things that go on betwesr 
a physician and: his patient, or the patient's relatives. Do 
we not need soncething in evaluating procedures here? 

It is curious to note that the evaluation studies review^ii 

rarely made note of the: .research done in other areas that was neiLevss^- 

to the subject. Most of the design problems evident in the evalimtii^ 

of continuing medical education have been tested elsewhere — part±cnaata_Tr 

in the general field of adult education. Such research makes it 

essary for continuing education in medicine to re-invent the wheel-. 

Costs : 

Herzog (116) provides the most recent and detailed estlmatei:^iEg' 
the cost factor in the evaluation of continuing medical education. Sfe 
has analyzed and compared the cost of several approaches to evaluatifflte 
showing the relative cost of each (Table V). 

According to Herzog, "The guiding principle in judging how mtxch 
should be spent for evaluation is that marginal costs should approach: 
but not exceed marginal value of the information obtained." Even then 
he admits great difficulty in assessing effectiveness values versus 
costs but he does suggest that since ".•.studies on behavioral change 
or patient health status rgreatly exceed course costs, they can be 
justified only as they relate to the objective of contributing to 
general knowledge." 
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CHAPTER VI 
SUMMARY AND CONCLUSIONS 

Professional education in the field of medicine is divided into 
three distinct phases: 1) Undergraduate education leading to the M^.D. 
degree; 2) graduate education covering the internship, residency, or 
other full-time study leading to a license, a professional specialty, 
or to an academic degree; and 3) continuing education which includes 
those activities in which practising physicians engage to acquire the 
new knowledge and skill necessary to keep current in their profession. 
The first two phases have received the major attention of the profession 
over the years but continuing education is now becoming a matter of . 
central concern. This concern is not necessarily new, for some of the 
concepts currently considered new have been recognized and documented 
in the literature over the past half-century. At first, continuing 
education in medicine was concerned primarily with correcting de- 
ficiencies in basic medical education and in th±E respect, medicine 
was following the tradition then current in the larger field of adult 
education* Since 1930, emphasis has shifted from remedial education 
to the learning necessary to keep up to date in a rapidly expanding 
professional body of knowledge. 

SUMMARY 

This review of the literature published from 1960 to 1970 has 
been concerned chief ly with the development of programs for continuing 
medical education. The material reviewed has been discussed under four 
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main headings and Is summarized below* 
Participation ; 

Although based on a limited number of available surveys this 
review of the perceptions of learning needs suggests that there are 
many reasons , both personal and professional, which determine how 
much continuing education a physician takes, and where and how he 
takes it* While there is some indication that specialists and phy- 
sicians in metropolitan areas attend courses more often, age is the 
only variable which bears a significant relationship to attendance 
patterns* ^ 

The recurring theme underlying all discussions, is that the 
physician, and more particularly those in general practice, are busy 
and their time cannot be wasted* At the same time, a multi-faceted 
continuing education ne?id exists « While these needs, both general 
and specific to the practitioner's location and field of practice ave 
identifiable, less evident are those related to the physician's in- 
dividual practice. Furthermore, there is some indication that a phy- 
sicians' felt learning needs may not be those most pertinent to his 

immediate medical practice* 

- .. * 

Hence it would seem that those programs which involve practi- 
tioners in identifying their "real" educational needs are more likely 
to succeed than tho^e prograns predesigned and presented. Moreover, 
while physicians awist often select the traditional methods and tech- 
niques, surveys ecggest that familiarity with the different approaches, . 
as well as age, and field of practice, are important variables influ- 

ERIC"' ■ -:■;■,■■■] 
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enclng choice. Thus it is apparent that a wide variety of approaches 
are indicated, taking into account these variables, and utilizing those 
methods and techniques to which physicians feel that they can respond. 
Organization and Administration : , • 

Most medical schools » professional societies, hospitals, and 
voluntary agencies, are actively engaged in providing educational pro- 
grams for practising physicians. The major problem confronting these 
sponsors is the lack of a sound administrative and academic base capable 
of adapting programs to the nature and needs of physicians in practice. 

The areas of identified needs include: 1) improved methods of 
determining real learning needs; 2) more clearly defined program ob- 
jectives, both short and long term; 3) administrative arrangements which 
would facilitate the planning of interrelated program offerings scheduled 
to meet the varying needs and preferences of busy practitioners; 4) a 
more sound fiscal 'base which would permit more long term continuing ed- 
ucation; and 5) the improvement of the quality of instruction provided. 

Despite these limitations , there are clearly discernible trends; 
1) local and regional conditions more conducive to the establishment of 
a national plan; 2) greater standardization (minimal standards) of course 
offerings through the AMA's program of accreditation; 3) a greater 
concerted effort to motivate physicians to continue their education; and 
4) a definite trend toward the decentralization of programs, using the 
community hospitals as one of the major foci of continuing medical ed*' 
ucation. 
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Instructional Processes; 

In 1963, Miller (159) wrote. 

This may sound like the repititious beating of an old and 
very tired horse, but the simple fact seems to be that con- 
tinuing education today, like continuing education thirty 
years ago, is obsessed with the notion that exposure to the 
learned assures learning. Yet each generation rediscovers 
the fact that in the end it is the learner who must do the 
learning, and no amount of communication by lectures, by 
book, by film, by radio, or television, will make the slight- 
est difference unless he does something with what he receives. 
Both teachers and students have for too long allowed them- 
selves to be deceived by the comfort of Instructional methods 
that require little more than a student *s presence, or by the 
gesture toward active participation embodied in the question 
period. 

In continuing medical education, almost every method, technique, 
and device known to education is presently in use. Yet, there is little 
evidence to suggest that any one media or technique contributes to more 
or better learning. Moreover, close examination suggests that even the 
most versatile of the newer educational technologies has been used large' 
ly in isolation, and mainly to provide physicians access to new medical 
knowledge. 

As it stands at the tioment, the field of medicine has made a 
greater Investment than any other in the use of instructional technology 
Unfortunately, this experimentation has not been well grounded in adult 
learning nor has it been studied adequately to determine its precise 
role in the achievement of learning and the resultant improvement of 
patient care. Consequently, there is no hard data available to indic- 
ate which kinds of instruction under what circumstances and for what 
kinds of participants best achieve the learning objectlvesi desired* 
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Evaluation : 

Evaluation in continuing medical education has been approached 
in several ways: by counting attendance! by obtaining pai ticipants ! 
reactions; by testing achievement; by measuring changes in medical 
practice; and by measuring end results of care. 

Measurement techniques have been as equally varied. These 
include: "The use of motion picture film in testing observation; an 
erasure technique allowing the testing of clinical problem-solving; 
the application of certain simulation techniques in testing diagnosis; 
the substitution of non-patient for a real one to facilitate testing 
of clinical performance" (2); and more recently, the use of the medical 
audit. 

Despite these efforts, this review of studies on evaluation has 
found a general lack of substantive research and can but repeat the dis^ 
couraging conclusion of many writers in the field that continuing medi^ 
cal education may not be having a demonstrable effect on medical care. 

From experience in the area of general adult education, perhaps 
Knowles (132) offers the best advice: 

Fundamentally the issue as to how much and what kind of evalu-^ 
ation a given adult educator will engage in will be resolved ^y 
referring to his philosophy of education. , .indeed, his very 
definition of education. If he defines it as a process of 
educating a person, of taking responsibility *f or making changes 
in a human being' ... then he does certainly incur an obligation 
. to measure as precisely as possible what he is doing to that 
person and subject his findings to ethical review. His evalu'- 
ation will also be greatly concerned with ef f Iciency . . .with 
getting data to determine whether or not he is producing max-^ 
imum change in the shortest possible time at the least cost. 
His dominant theme will be quantlfl;cati;on/ But If he def inea 
education as a process of fa;cllttating and providing XQsources 
for self -directed inquiry and self development, he tticura an . 
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obligation to involve the participants in collecting data 
that will enable them to assess the effectiveness of the 
programs in helping them accomplish their objectives. His 
dominant theme is involvement, 

CONCLUSIONS 

In considering the expansion of continuing education in med- 
icine, one of the more promising recent developments has been the 
American Medical Association's accreditation program. Although it 
is still to early to assess its overall effect on the field, ultimately 
it should help to establish minimum standards, thereby Improving the 
quality of program offerings. Equally important is the growing trend 
toward making the community hospital the major foci of continuing ed*- 
ucation. 

Extensive experimentation in the use of the mass media also 
promises to extend continuing education beyond th.e confines of the 
uuiversity campus and it has helped to focus attention of their poten^ 
tlal for self-instruction. 

Despite these and other positive features, many negative trends 
persist. The majority of programs , have been designed to assist phy- 
sicians in keeping up with advances in medical knowledge, even though 
the research suggests that the application of new knowledge may be leiss 
crucial than the utilir.ation of what is already Imown about good medi- 
cal practice. It would seem that more seqiiientially planned, elinically. 
oriented programs are indicated, and faculty equipped to facilitate 
learning rather than simply to communicate more information. 
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At the same time, other types of flexibly organized programs 
are required in order to help busy physicians meet their individual 
requirements for learning. There is an obvious need for more studies 
on the impact of educational programs measured in terms of clearly 
defined objectives and studies on the overall effect of continuing ed- 
ucation on the quality of patient care. Because of the complexity and 
expense involved, the combined efforts of organized medicine is essential. 

Other challenges facing the profession include the continuing 
experimentation and evaluation of different Instructional techniques 
along with the newer educational media. The many information sources 
such a journals, consultations, and time on teaching servies, which phy- 
sicians indicate are widely used as a means of keeping current need to 
be inore carefully studied • 

Indeed, it would seem that the term ^'continuing education" must 
be expanded to include not only formal courses, but these and the many 
modalities through which physicians may >eek their own continuing 
learning. As stated by Houle (282) "If the practice of learning in 
groups can be studied, why cannot individual study?" 

The many organizations involved in continuing medical education 
must share the responsibility for devising a total system, whereby all 
instruments for learning may be Integrated into a comprehensive ongoing 
program of continuing education for the practising physician. 

The need to co-ordinate the pre-prof essional program with con- 
tinuing medical education requires serious consideration. There is 
little evidence that an ongoing curriculum from undergraduate to con- 
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tlnulng education has been established. Even more . important is the 
need to inculcate early in the medical student's career, the concept 
of lifelong learning as a part of his general professional orienta- 
tion. 

The study and practice of medicine is based on the scientific 
process and, at least in theory, those engaged in the field are trained 
to solve problems through use of the scientific method. Therefore, it 
is curious that so little of the scientific method has been applied to 
the design, management or evaluation of continuing education in medicine. 
Certain fields of knowledge in the social sciences have accumulated a 
vast amount of valid data that is immediately relevant to continuing 
medical education, yet the reports reviewed here showed little evidence 
that such knowledge is recognized, accepted,,and used by the field of 
medicine. Many of the problems and issues faced in the studies reviewed 
have occurred in other fields so that continuing medical education can 
profit from that experience. 
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CHAPTER VII 
THE PROFESSION AND CONTINUING EDUCATION 

For those familiar with the nursing profession, it would seem 
superfluous to reiterate the many well known and well documented problems 
in nursing*. Nevertheless, in order to understand both the limitations 
on and the needa in continuing education, it is necessary to re-examine 
briefly some of the problems as well as the trends in contemporary nursings 

NURSE COMPOSITION AND DISTRIBUTION 

Nurses comprise the largest single group of health prof essionals 9 
and even ignoring the vast number of practical nurses, orderlies, and 
other auxiliary nursing personnel, the nurse-patient ratios in Canada 
and the United States are amotg the highest in the world, 1:164 (76) 
and ls302 (69) respectively. Moreover, for the past several years, 
employed registered nurses have been increasing at a rate of approx- 
imately 3 percent per year in the United States (31) and by 7 to 8 
percent per year in Canada (30) < These figures are less impressive when 
one considers that roughly one quarter of the nurses are employed 
part-time and that the attrition rate is high in nursing (57). Since 
nursing is largely a women's profession of whom well over one-halS are 
married (76), it is expected that these trends will continue in future. 

At the same time, a number of studies (101) (122) (57) disclose 
that a significant percentage of inactive nurses would be willing to 
rje-enter the v»ork force, provided refresher courses were made available* 
They also suggest that the majority of Inactive nursef? are diploma 
graduates and most are seeking part»*time employment. As pointed out in 
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the recent report of the National Commission on Nursing and Nursing 
Education (69) , while re-activation of this group may well satisfy certain 
manpower needs, it does not necessarily meet the need for nurses with 
advanced educational preparation, nor does it necessarily guarantee a 

stable work force. 

In 1968, t"ie majority of Canada's registered nurses had no academic 
degree, 5 percent had a baccalaureate, and less than ' percent had a 
higbec degree (30). Comparably, in 1966, only 10.6 percent of the register ad 
nurses in the United States had baccalaureates, and 2.5 percent a higher 
degree (5). On the other hand, the general consensus is that 25 to 33 
percent of the present positions in nursing require at least a baccalaureate 
(76). These data lend support to the conclusion that "the production of a 
sufficient number of nurses may be less of a problem than the production 
of enough nurses with higher degrees for those positions where it is felt 
that such preparation is essential" (57). 

Trends in Composition and Distribution ; 

Of the registered nurses at work the majority are employed by 
institutions and agencies, particularly by hospitals. Indeed, as shown in 
Table I, the most significant trend over the past forty years has been 
the decline of independent practice. In spite of the increasing emphasis 
on community health care, in 1968 onl 3 percent of employed nurses in 
Canada were engaged in public health or occupational health nursing, as 
compared to 15 percent in 1930. Recent employment statistics on nurse 
manpower in the United States suggest a similar distrlbutlou In that country 
(6). 

ERJC jjjg average aiiEual turnover rate for registered nurses working general 
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duty in hospitals in 60 percent in Canada (75), and 70 percent in the 
United States (69). Using the oft quoted estimate provided by Taub and 
Keiibin of "$500 to replace one nurse" (108), the economic implications of 
theae turnover rates is obvious. Equally significant, hqv/ever, is the loss 
in terms of nurse effectiveness, not only to the new staff nurse but also 
to all those involved in her orientation. As one in-service co-ordinator 
writes, "Inservice education is not a luxury or something nice to have in a 
hospital, it is a necessity. Because of a rapid turnover of personnel 
our audience is a parade" (113) . 

Because nursing is a profession composed largely of female workei'S 
this may account for the high turnover but according to Murray (75) , the 
turnover rat^s in nursing is anywhere from 20 to 30 percent higher than for 
other predominately ;^emale occupations. Ixt his study, Murray attempted to 
identify those variables accounting for the rapid turnover of general 
staff nurses • He found that with the exception of younger nurses who 
tended to be more mobile, no clear pattern emerged. On the average, part- 
time nurses were no mi^rra nor less stable than full time staf i . Nor 
did size of hospital or size of community necessarily correlate with job 
mobility. He did conclude that "nursing turnover is not all a case of 
being ^pulled 'away from a job; at least some of it may be due to being 
'pushed' as a result of dissatisfaction with a particular situation." He 
recommended - as have many others (89) (15) (69) • that "small work groups 
be created to foster a feeling of autonomy and belonging, and that provision 
be made for inservice education which would Increase professional develop- 
ment and make staf f-'^ore capable of contributing to the decision making 
process" (75) 

Changing Patterns of Practi ce; 

As new patterns of medical care evolve, the role of the nurse is 
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changing. Nursing In hospital has become Increasingly managerial, 

specialized, and technical, and many patient care procedures formerly 

carried out by physicians are now performed by nurses (62). Whether or 

not the nurse should meet these ever increasing dcunands is debatable and 

many attempts have been made to clarify the * unique 'functions of the nurse 

(95) but there still remains considerable confusion on the part of nurses, 

physicians, and other members of the health team as to what is the role of 

the nurse (109), (S?) , (75). 

Adding to the problem of role has been that of qualific;rr.ion«. 

There has been a struggle within the nursing profession over the adequacy 

of the two, three, or four year pre-prof essional educational program. 

While much has been written comparing graduates from the different programs, 

there is little concrete data to assess differences. A recent analysis 

of test results by the National Commission on Nursing and Nursing 

Education (69), disclosed a considerable overlap in the scores achieved 

by graduates of all three types of programs , and with at least as much 

variation within each. On this issue, the Commission simply concludes: 

While it can be expected that greater differences will 
emerge in areas like clinical performance ... it 
seems likely that differences within the programs will be 
at least as great as differences between them, and any 
health care facility, that employs nurses must take 
these variations into account in its orientation and 
induction procedures. 

In the prarJ:ice setting any consideration of individual difr- 
erences appears to be the exception rather than the rule. One recent 
survey of eighty directors of nursing service disclosed that the 
"standard measurirt^ stick'' for all graduates was their ability to 'cope' 
and function within the traditional hierarchial structure of nursing 
Q service which in effect means rating the nurse according to the amount 

IC 

^mof administration and other task oriented experiences she has had (35). 
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Harrington and Theis (50) found that under such circumstanceis , many bacca- 
laureate graduates suffered role deprivation. On the other hand. Price (89) 
notnd that at all levels and regardless of educational preparation, there 
was "an unintentional commitment on the part of the nurses to the per- 
petuation of the system". Thus she concludes, ''Both preservice education 
and hospital organization must be changed to improve the situation". 

While the present organization of nursing services is an anachronism, 
the fundamental difficulty in assessing these problems is the lack of 
research into nursing practice. There is "little object:i\'e evidence avail- 
able upon which to base judgements as to what is the proper scope of practies, 
what class and types of practitioners are needed, and what kinds and 
arounts of education each requires" (93). 

In recent years university graduate programs in nursing have 
focussed on the preparation of expert nurse practitioners or clinical 
specialists who can help define nursing practice in the clinical areas md 
conduct research into patient care. Although many consider this one o£ 
the most promising trends in nursing, it is now being questioned as to 
whether a "sufficient number of clinical specialists can be produced to 
make a significant impact on the overall system" (78) . 

In the meantime, as the need for health services accelerates, 
physician directed programs designed to produce nurse clinicians in the 
acute and ambulatory care settinga have been increasing, and while both 
physicians and nurses appear to agree that as health care needs change 
roles must change, so that the role of the nurse is expanded, there is 
little agreement about the educational preparation required. ^ A recent 
study in Ontario (97) disclosed that while nursing educators believed 
that the expert nurse cliisiician should be prepared at the graduate university 
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level, the Ontario Medical Association maintained that such a person 
need be only a diploma graduate, with sevex^al years of on-the-job 
training resulting in clinical competence in one area of nursing • A 
recent interprofessional survey in the United States disclose.^ similar 
findings (98). 

Despite these opposing viewpoints, both groups are much more 
willing to compromise on behalf of optimum patient care, and this 
reciprocity of roles is evident (65) , (8) • While prof escionai isolation 
isms will not soon be resolved » changes in the reciprocal roles of 
physicians and nurses is a significant trend that has Important implica- 
tions for continuing education in nursing. 

CONCERN FOR CONTINUING EDUCATION 

The American Nurses' Association (7) includes three types of 
educational activities under the term continuing education for nurses*: 

1. Fo7*mal academic study in programs leading to a 
baccalaureate or higher degree; 

2. Short term courses or programs offered by institutions 
of higher learning but not necessarily directed toward 
a degree (these are generally referred to as "con- 
tinuing education courses") , and: 

3. Independent or informal study carried on by the 
practitioner herself utilizing the learning 
opportunities available to her through her 
profession or her employing agency. 

This review is concerned with the latter two categories of 

continuing education, but more particularljr with those non-credit 

courses sponsored by institutions of higher learning, and Inservlce 

education provided by employing agencies. 

*The term "nurse" as used in this report refers to thor 
^^Bgistered nurses graduated from hospital schools j» junior (Colleges , 
^id university schools of nursing* 



Of the two types of programs, Inservlce education la the oldest, 
and probably still the most prevalent form of continuing education in 
nursing. Pf s^f ferfcorn's historical reviev (88) published in 1928 provides 
evidence that as early as 1905 postgraduate nursing courses vrcre being 

" -^.Ted in a variety of taedical specialtierj. She reports that these 
programs were not well developed and that many were being given merely to 
increase the work force of the hospital. She further notes that educational 
opportunities for the general staff nurse were almost non-existent. 

Straub (107) reviewed the nursing literature between 1928 and 
1950 but found few articles related to the inservice education of nurses*. 
She noted an increase in the number of publications from 1950 to 1960 and 
that the main emr lasis of most of these related to techniques of program 
development or program descriptions, and that the research was limited to 
descriptive surveys or opinions of participants about tha programs. 

This present review covers the decade of the sixties and found that 
the calibre of the published literature has changed very little. There are 
many articles of the type, "How we plan our program" (99), (34), (61), (123), 
and program descriptions concluding *'We felt that the training program was 
very successful" (117), (71), (84), (104), (58), but there is little 
objective data to justify these convictions Indeed, recurring themes are 
problems such as the rapid turnover of staff, the differing levels and 
preparedness of nurses, the demands of a busy nursing service, and 
reluctance of nurses to atr:end programs (89) , (111) , (36) . 

Continuing education as a component of higher education is very 
recent in nursing. It was generally accepted in the past that the major 
commitment of the university school of nursing must be to the undergraduate 
and graduate programs (54). Accordingly, althou);h continuing education 
courses are reported to be Increasing in ntmber <48) , the more sequential. 
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long range programs are the products of a iL^elattvely few universities. 
In the United States, RMPS (regional medical programs funded under the 
terms of Public Law 89-239) , and the Western Commission on Higher 
Education in Nursing (WCHEN) have also been active in the development 
of continuing nursing education. 

In 1968 Mrs Slgne Cooper at the University of Wisconsin held the 
first national meeting on continuing education in nursing. The primary 
purpose of this meeting was to provide a forum for the e»xchange of ideas and 
developments relative co the field (92), In 1969, concurrent with the 
Fourteenth Congress of the International Council of Nurses held in 
Montreal, Mrs Margaret Neylan from ti ^ University of British Columbia 
callefd a sLullar meeting (91) . 

Subsequently, two national conferences have been held specific- 
ally for those nurse educator^ woi^klng in the field. The first of these 
held in Williamsburg, Virgini 1969, focussed* on the leadership role 

of institutions of higher learning in continuing nursing education (90) . 
The second, held at Syracuse University;. New York in 1970, took as its 
theme the organization of continuing education for the implementation of 
change (51) . 

The third national conference held in Wisconsin in October 1971 
had as itJ^ major theme critical Issues in continuing education in nursing. 
An issue of the Journal of Continuing Education in Nursing (51) was 
devoted to papers developed around the issues discussed at the con- 
ference. In brief, the major concerns as expressed in thesa papers are 
as follows: 

Will short term courses presently preparing pediatric 
nurse practitioners prevent a rapid and necessary Increase 
of the nursing specialist prepared at the graduate level? 
Present graduate programs are not preparing sufficient 
numbers of expert nurse practitioners. Can we afforc^* 
to Ignore the need? 
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Continuing education is fragmented, disorganized, 
unrelated and haphazard. Can these activities be co- 
ordinated in a reasonable rational approach? The great 
proliferation of opportunities in part reflects im 
expressed educational need by nurses, but could vic^e 
• be accomplished through better co-ordination? 

VJhat are the unmet needs and educational gaps? And 
whose responsibility is it to meet these needs • * • . 
or even to identify the needs? 

Who pays for continuing education in nursing? Granted 
that the learner has some personal responsibility, 
what about the enploying agency? 

Does continuing education make a difference? When we 
can identify more specifically how improved nursing 
care results from our various educational activities , 
perhaps we can expect more support, financial and 
otherwise* 

Research Interests 

In her report of a national survey of all colleges and 
University schools of nursing in the United States in 1969, Gwaltney (90) 
Identified the following research underway in the areas of continuing 
education for nurses: 

Univg.:c3ity of Wisconsin ; 

1. A Study of The Continuing Learner in Nursing: September 1, 
1962 - 1963, 

2. A Survey of Inactive Nurses Enrolled in Refresher Courses: 
September 1967, 1968. (In progress)* 

3* Evaluation of the Effectiveness of the Nursing Dial Access 
Program. (In progress)* 

University of North Carolina s - 

A Study to Determine Whether the Preparation of a Nurse for 
Coronary Care Has an Effect on the Condition of Patients at 
Discharge From Coronary Care Unites in the State • In collaboration 
with the School of Public HealCrh, Dept of Epidemeology and 
the Regional Medical Program. 



* Completed and available 
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Syracuse University 

Following the programs, Improved Management Skills: An 
Approach to Better Patient Care: The Dept of Psychology did 
the evaluation of the program^ 

St Louis University 

Limited local survey of education needs (1965 and 1968). 
Committee on Continuing Education Study on Evaluation form 
data, 1968. 

Tlirough library research as veil as correspondence with over 

thirty universities, in both Canada and the United States, the following 

additional studies illustrate the nature of current research underway: 

A Survey of Inactive Nurses in Washington State. A study to determine 
the characteristics of inactive nurses, their reasons for not working 
in nursing, the extent to which they represent a potential nurse supply, 
and their interest in a refresher course. Sponsored by the Washington 
State Department of Health; Division of Nursing; University of 
Washington, School of Nursing; Washington/Alaska Regional Medical 
Program, 1968. 

A Survey of Continuing Education Needs for Health Professionals: Idaho; 
Montana; Nevada; Wyoming; Sponsored by WIGHE/Mountain States Regional 
Medical Program, 1969. 

Nursing in Idaho: A Study of Nursing Needs and Resources; Sponsored by 
the Idaho Office; Mountain States Regional Medical Program; WICHE in 
co-operation with the Idaho State Nurses* Association, 1969. 

An Evaluation of t. Continuing Education Program; WICHE in co-operation 
with the Idaho State Nurses' Association, 1969. 

An Evaluation of a Continuing Education Program in Nursing; University 
of Colorado, Boulder, Colorado; I960. 

Evaluation of Regional Continuation Education Conferences. 

The Effectiveness of a Leadership Program in Nureing; Supported by Public 
Health Servicr _.jt from the Division of Nursing; Bureau of Health 
Manpower and /citute of General Medical Sciences, United. States Public 
Health Service, 1967. 

Continuing Education for Nurses: A Study of the Need for Continuing 
Education fdr Registered Nurses in Ontario; Sponsored by the School of 
Ifersiag of the University of Toronto in co-*operat±on with the Division 
of Uaiversity E'tension, 1969. (25). 
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A Report of a Questionnaire for Teachers of Nursing in Ontario; A Study 
of Continuing Education Needs: Registered Nurses* Association of 
Ontario, 1965. 

Continuing Professional Education Needs of Supervisory Personnel in 
Nursing Service and Nursing Education: Pennsylvania State University, 
1965. 

Correspondence Instruction as an Educational Method in Hospitals; 
Pennsylvania State University and the Hospital Research and Educational 
Trust of the American Hospital Association, 1967 (37). 

Management Training Effectiveness: A Study of Nurse Managers; 
Sponsored by the Texas League of Nursing; 1965. 

What Do Practising Nurses Want to Know? A Study of Learning Needs- 

As is evident, well over one half of the studies reported are 
descriptive of nuxse manpower resources and the nurses' perceptions of 
their learning needs. Moreover, most of the reported research on program 
evaluations are, at best, exploratory. 

In 1971, the American Nurses' Association was awarded a one 
year federal grant to conduct a national survey of continuing education 
for nurses. The purpose of this project will be to "identify all types 
of existing continuing education programs and resources" (66). It is 
hoped that the findings of this study will provide information which will 
help to determine the future direction for continuing education in 
nursing. 
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CHAPTER VIII 
PARTICIPATION IN CONTINUING EDUCATION 
Although there is no data available to indicate the extent of 
nurse participation in continuing education, using membership in the 
Ameri^:an Nurses' Association as a criteria, Curtiss et al (51) provide a 
national estimate of less than 30 percent. They stress that the "number 
of nurses aware of their needs for further study are to be found in 
encouraging numbers . " » 

CHARACTERISTICS OF PARTICIPANTS 
Through an analysis of descriptive data obtarlned from 314 nurses 
who attended the University of Wisconsin's Extension courses between 
September 1, 1962, and August 31, 1963, Cooper and Hornback (28) attempted 
to identify those personal-professional characteristics of nurses who were 
more likely to continue their professional education. The results of this 
study are summarized in this section, using other comparable data where 
appropriate. 

Location of Practice ; 

Nurses attending the University of Wisconsin extension courses 
during the period under study were almost exclusively from that state. 
Those counties not represented in the population tended to be more rural 
and employed fewer nurses. A recent annual report from the University 
of British Columbia (100) disclosed similar findings in which 90 percent 
of the course registrants were from the province, and 65 percent from the 
Grt^ater Vancouver area. 

ERIC 
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In a WICHE study (96), the great majority of nurse respondents Indicated 
that "because of family responsibilities, they would not attend short courses 
offered outside their local communities, even if expenses were paid." 

Position in Nursing Service : 

The majority of nurses participating In continuing education programs 
were full-time employees of hospitals. Supervisory personnel made up the largest 
single group of participants, with some 40 to 50 percent of the participants 
in this group. Staff nurses were next In frequency at something like 40 percent, 
with a miscellaneous category accounting for less than 15 percent of the parti- 
cipajnts. This distribution by position was found in both the Wisconsin study, 
the UBC Report, and most other similar studies (28) (43) (89) (100) (102). The 
generalization to be drawn from these data is that nurses in higlhv;v« positions 
attend more continuing education programs. 

In commenting on this generalization, Cooper and Hornback (28) ask: 

Are the learning needs of supervisory personnel greater than those 
of nurses on the staff level? Does this suggest that basic nursing 
programs do not prepare nurses adequately for these responsibilities? 
Or does this finding suggest that it is easier for supervisory 
nursing personnel to get away from their job to go to meetings? 

Marital Status and Age : 

In both the Wisconsin- and UBC reports, about one half of the participants 
were married or divorced. In the Wisconsin study, 45 percent of the participants 
had children, and one fourth of these had children under five years of age. In 
contrast, the UBC data found that over one half of the participants had no 
children. 

The Wisconsin study found that the largest percentage of participants 
were those in the older age group (50 to 54 y^ars). Similarly, the WICHE study 
found that nurses with ten to twenty years or more of active practice e^^pressed 
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the greatest need for continuing education. In contrast, the UBC data 
reveals a distribution that is somewhat equal in all age groups but with 
a marked decrease In those over 55 years of age. 
Educational Achievement ; 

The Wisconsin study reported that 22 percent of the participants 
had a college degree in contrast to 15 percent of the nurse population 
of Wisconsin that had degrees. In the UBC report, 18 percent of the part- 
icipants had the baccalaureate degree, 3 percent had a Master's degree; 
and 20 percent a diploma or certificate. These data ara consistent with 
participation studies, in adult education which lead to the generalization 
that participation in continuing education tends to Increase with formal 
education. 

Albeit based on a limited sample (N=79), in Shore's study 
(102) nurses with more education reported less participation In programs 
of continuing education. She attributed this finding in part to the 
higher proportion of yoiinatg: ^js^uates li& 1** ^asmle, iriio "^^rmfPs f«lt j.^^.jirg 
of ^ need f r contlnuiii(g^ ^^tdixrataor'^:., 

Fleck (44) found !£3at variables rauch as age, educatra.-cEal back- 
ground, years of experience, and marital status, did not correlate with 
opinions relative to Inservice education. She does note, however, that 
"In some Instances, the years of professional experience did produce a 
greater recognition of the need for continuing growth," 

Use of Other Information Sources ; 

In the Wisconsin study, over one half of the respondents 
Indicated that they held membership In the American Nurses' Association 
which contrasted with the 32 percent of the nursing population in the 




^Btate that reported such membership. Over one half of the respondents 
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±nd±cat:ed that they read two or more professionai j ovl 
Flaherty (A3) found that over one third of t 
Ontario felt that their educational needs were not be 
thirds were eligible for inservice education. Flaher 
part— time and private duty nurses fared badly in this 
found that nursing library facilities were poor and sl 
than one half of the respondents^ She also notes tha 
was used infrequently by the nurses" • Burt's study C 
staff ^aducation progr^ams in Washington state disclose 
cent of the respondents had done some reading or othe 
work in conjunction with the inservice program attend 
Professional journals and books ranked firsx: 
availability and use » while conventions and meetings 
the WICHE study C96>. On the other hand, short tessa 
available but the nurses felt that these were needed 
of nurses in each of four mountain states were asked 
they had received additional foarmal education or on— t 
work in the clinical area in which they were then emp 
regions , over 70 percent cf the graduate nurses had r 
eviueatlon or on— the— j ob training* Of the three level 
43 pe'ij^cent of the diploma graduates reported that tho 
additional fomnal education in the clinical area eomp 
of baccalaureate graduates and 9 percent of associate: 
The eourBes most likely to gain support are those whi 
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on what t\ie Xkux&e believes to be her owu learning needs or those which 

she found taost helpful in increasing her job proficiency (102), (16), (89). 

REASONS FOR PARTICIPATION OR NOT 

In the Wisconsin study (28) participants were found to attend 
courses for a variety of reasons, but none of the respondents attended 
because it was "demanded" by the employer or for reasons of promotion. 
The main reasons given for participation were interest, desire to improve 
teaching or nursing care, and advised to do so by employer. 

Family responsibilities was listed as the most important 
single factor preventing nurses from attending programs of contimiing 
education (37), (28), (43), (122), (96). Other important but related 
deterrents included time, expense, staff coverage (10), (96), (37), (25), 
nothing available, and/or distance (96), (28), (43), (57), insufficient 
adtiranced notice of course offerings, and/or inadequate :puh2ax:ity regard- 
i2i^.the^iconrse (25), (28). In the Ontario Survey of NeedH (25) employers 
stated that it was difficult to plan continuing education programs for 
staff development when little advance notice of course offerings was 
given. Nurses were reported reluctant to take advantage of opportunities 
available when costs for attending courses on short notice prohibited 
its inclusion in the hospital or agency budget. 

In her study, Burt (16) found that of the fifteen hospitals 
polled, four made attendance compulsory at inservice education programs, 
and one hospital specified that "attendance was required for some, but 
not all nurses." In the remaining ten hospitals attendaiace was volunt- 
ary. Pays on and Salloway (84) found that one of the major reasons 
Q^\£f members did not like the inservice programs was because they were' 
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compulsory. On the other hand, some respondents Indicated that once they 
got there they found the programs enjoyable. Fleck (44) concluded that 
the major obstacles to participation in inservice education programs 
were: 1) the rotation of hours and the heavy workload which limited 
attendance; 2) unplanned, dull» poorly presented programs; 3) the 
general indifference of the majority of staff nurses to inservice education. 
These findings are not too different from thosB reported in the Pemsyl- 
vania study (10) . 
Scheduling : 

Most Burve^^ nsffiLsclose that nurses want continuing education 
presented in their local communities (69), (57), (335), (122). In the two 
WICHEtMSRMP surveys oveir.SS-rpcercent of :the respOTiteniDs indtixrated tiioL 
they would attend short CTjurees if theser were .offered in their bxsBS^ 
^communities. The frequency ^th which they would be willing to attend such 
courses is shown in Table II. 

A survey of inactive nurses in Wisconsin (96) disclosed that 
of the respondents who were interested in returning to nursing, 73.12 per- 
cent desired refresher courses scheduled as part time classes with roughly 
one half preferring a day time schedule, and the other half an evening 
schedule; 67.65. percent of the Inactive nurses expressed a willingness to 
travel but one half would not commute over ten miles in order to attend 
refresher courses. A survey (97) of teachers of nursing in Ontario found 
that the majority of teachers would like courses scheduled in the evenings 
and the months most favoured were February and March. 

Cost ; 

O In Flaherty's study in Ontario (43), 40 percent of the respondents 

ERJC 

"■^ported that employers granted them time off or pay to attend programs. 
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ineetlngs and conferences • The most favoured groups in this regard were 
those in administration, teaching, and public health nursing. In the 
Wisconsin study (28), three quarters of the respondents had their fees 
paid by the employing agency. In most cases., this was the entire fee or 
through time reimbursement in the form of "giving on duty time". Asked 
if they would be willing to pay their own fees , nearly 62 percent 
responded in the affirmative while approximately 12 percent responded 
negatively and one quarter did not respond to the question. Referring 
to the non-respondent category. Cooper and Komback ask: "Does ±t 
imply indecision or t-an ±x be aa^sumed that the majority of these nurses 
would not have attended the institute had they been expected to pay their 
own fees?" (28) . 

Although it is impossible to draw firm conclusions on the 
basis of the limited data avaij^ble, a number of reports suggest that 
many nurses expect some type of reward for continuing their own 
education. As previously noted, in the Ontario Survey (25), employers 
reported that nurses were often reluctant to finance their own 
attendance at courses. In the WICHE:MSRMP surveys (96), only 24.2 per- 
cent and 27.4 percent of the registered nurses indicated that they 
would attend programs outside their own communities at their own 
expense, whereas 55.8 percent and 63.3 percent would attend if theii: 
expenses were paid. Similarly, Goldfarb (46) notes that "most of the 
nurses who take the course expect compensation upon successful completion" 
however, "they we7:e not sure where the compensation was to come from 
or what it should be" (46). 
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Felt Learning Needs ; 

Surveys which have used open ended techniques to identify the 
felt learning needs of nurses reveal some striking similarities in 
responses. Regardless of position or type of agency, one of the most 
prominent needs listed is that of improving communication and management 
^leadership skills (36), (10), (43), (37), (25). Other learning needs 
rated high in the list of priorities Include: newer dimensions in 
nursing care; legal aspects of nursing; and the changing role of the 
nurse. In the Pennsylvania study (36), many nurses ^^ere being 
promoted into admtnistiativey supervisory, and team leading positions 
with little preparation for their new responsibilities, and hence were 
insecure as managers. Accordingly, directors of nursing were in full 
agreement that there was an urgent need for courses to improve the 
supervisory skills. 

In the Ontario Survey of Needs (25) , employers both of public 
health and of hospital nurses expressed a similar view. Directors of 
nursing also Indicated that they looked to continuing education courses 
to fill the gap created by the phasing ouK of the one year certificate 
programs on nursing service administratloh. Other pressing needs 
revealed in this survey were: 1) courses to Increase the teaching 
skills of nurses In different fields and levels of nursing, including 
public health nurses, inservlce co-ordlnators and occupational health 
nurses; and 2) specialization in nursing , notably in the area of 
^Intensive care nursing, chronic disease, mental health, and 
rehabilitation « 
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Utilizing a modified survey or "slip technique," Skinner and 
her colleagues in the Michigan RMP (103) gathered opinions about the 
current learning needs of staff nurses, teavi leaders, and head nurses in 
the care of patients with heart disease, cancer, stroke, and related 
diseases. Forty-eight nurses representing each level identified not only 
the broad learning needs referred to in the foregoing surveys, but also 
specific learning needs directly related to patient care, including 
1) how to position acutely ill patients to prevent deformities and other 
complications; 2) how to read EKG'a and recognize death producing 
arrhythmias; 3) how to be more effective in teaching patients and 
families i 4) how to care for terminally ill patients; 5) how to care 
for patients receiving chemotherapy and irradiation. 

Using a scaled questionnaire and interviews, Tiffney (109) 
sought to determine the competencies of general staff nurses functioning 
in the field of rehabilitation. She concluded that general duty nurses 
lacked the necessary competencies for effective work in rehabilitation. 
Although the nurses interviewed emphasized that their role was not under- 
stood or appreciated by the other disciplines on the rehabilitation team, 
Tiffney adds, "this no doubt was aggravated by an apparent lack of 
understanding on the part of the nurses themselves as to what the functions 
of the nursing staff include". Among many recommendations, she urged 
that short term courses in rehabilitation be set up, organized, and 
Implemented by qualified personnel as a crash program to alleviate the 
shortage of graduate duty nursea who require this preparation to function 
as skilled practitioners. 
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In the study of teachers' learning needs (97) over 80 percent 
of the respondents requested content related to the biological and 
social sciences. The teachers expressed the greatest need for subject 
matter specifically related to their own field of practice • As a 
result of this survey, six 3-week institutes for teachers of nursing 
were conducted, iilthoagh a relatively unsfrructured program was planned, 
it soon became evident that the rv^sal learning need of the instructors 
was not course content ^ but rather how to apply it in situation--type 
probleiDS in clinical practice (94). 

Price (89) attempted to identify learning needs in two ways; 

The first was a self report of a critical incident encountered the 

previous year which the nurse considered of extreme significance and 

related to her lack of preparation. The second was an identification - 

of the learning need which the nurse thought would enable her to best 

improve the quality of care she provided to patients. Using this 

approach 9 Price found that while the nurses reported their greatest 

learning needs to be indirect pati^.nt care, most of the critical 

Incidents related to direct patient care. More specifically, the 

greatest needs and/or problems related to "insecurity regarding 

nursing care, new techniques, methods relating theory to practice". 

Concerning many of the critical Incidents reported, she states; 

This indicates a failure of transfer of learning 
from past experiences. If this does not take place 
pre-seirvice education must be considered Inadequate. 
The pre-service education of the individual nurse 
should enable her to analyse her own abilities and 
recognize her needs for additional learning (89). 

Price indicated that learning needs reported most frequently 

In the area of Indirect patient care were those* related to leadership 

and management. In this area, skill In handling people was given 
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primary emphasis. It was also indicated that clarification was needed 
with regard to current programs In nursing education and regarding 
Interpretation and implementation of hospital policies. On the basis 
of her findings. Price concluded that there was no advantage in trying 
to group nurses for inservice education according to the amount of 
professional training received, whether their preservice clinical 
experience was in the hospital in which they were employed, or on the 
basis of the number of years away from hospital nursing. She con- 
cluded that the homogeneity of learning needs was probably most 
related to functional role* type of care given, years in nursing, 
and length of employment. 

Methrda and Techniques : 

A recent survey (10) revealed that the instructional techniques 
most preferred were: lecture, group discussions, films, handouts, panel, 
and role playing, in that order. Fifty-eight respondents expressed 
opinions. One of the most frequent requests relative to improving 
instruction was more leamer participation. Similarly, Burt (16) 
found that many of the nurse respondents would have liked more 
opportunities to volunteer comments and engage in discussion with 
colleagues . 

On the other hand, nursing teachers administered a post- 
Institute questionnaire which indicated that the "least helpful aspect 
of the programs were the small group discussions". The reason given was 
thaL "the group wandered from the topic". At the same time, observations 
by resource persons during the institutes indicated that the d^jvelop- 
ment of group discussion and conference skills were a very prominent 
need among teachers of nursing attendiag the Institute. 
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The references found relative to t\ ^ and opinions 

of nurses about the newer mass media and Jtv al methods 

suggest that nurses are willing to utilize these where available (2), 
(14). In the WICHE study (96), nurses, particularly younger nurses, 
expressed an urgent need for programmed instruction, television, radio 
and educational films, more or less in that order. 

A recent survey (10) by the school of nursing at Pennsylvania 
State University disclosed that 60 percent of the responding hospitals 
would be willing to experiment with television, while 21.42 percent 
would not and 18.57 percent were undecided* The major problems relative 
to its use were: cost, lack of facilities or equipment, and the quality 
of the program, in that order. 
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CHAPTER IX 
PROGRAM, ORGANIZATION AND ADMINISTRATION 

A number of different groups sponsor programs of continuing 
nursing education including the universities and their schools of 
nursings employing institutions ^ notably hospitals and public health 
agencies - nursing and hospital associations, and voluntary or specialty 
health groups. Of these , the universities, hospitals, and nursing 
associations are the primary sponsors of formal programs. 

SPONSORS AND PROGRAMS 

Since there is no nationally systematized method for reporting 
the numbers and types of current course offerings , the information 
provided in this section represents data gleaned from a variety of sources 
which reflects present patterns and trends. 

Nursing Associations 

In a recent article, Spector (105) wrote: 

Continuing education in the American Nurses* Association 
is like an iceberg. That is, its clinical conferences and 
publications are clearly visible* What is less evident 
are the following: the efforts expended by the national 
association to encourage the development of continuing 
education programs and make it possible for the profession 
to determine the standard of its education and practice. 

More specifically, the role of the national nursing associations 

relative to continuing niirslng education has been: 1) to procure federal 

funds for both graduate and continuing education; 2) to encourage the 

development of effective orientation and inservice education programs in 

the employing agencies; 3) to promote the return to nursing of Inactive 
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nurses; and 4) to provide information to nurses regarding various 
alternatives for professional advancement through formal education 
(95), (7), (105), (86). 

In addition to the forr the Canadian Nurses' Association 

(CNA) provides a Library Loan . on nursing publications, while 

the tvTo major associations in the United States offer for rent or 
purchase various teaching aides and resources. More recently, the 
National League for Nursing (NLN) is reported developing programmed 
instruction on various aspects of clinical nursing (118). 

In 1967, the American Nurses Association (ANA) received a 
$50,000 federal grant to promote a nation-wide program of refresher 
courses to encourage a target of 30,000 inactive nurses to return to 
nursing within one year. The Association's primary role in this 
venture was to identify inactive nurses and to involve agencies, 
particularly state nursing associations, in the provision of the courses* 
As part of its responsibility, the ANA designed a set r^f guidelines and 
a model course which was subsequently published (32) . Since this 
original drive, further grants have been made to expand the ANA's 
promotional efforts (13) . 

For the past decade the ANA has been sponsoring three day 
regional conferences focussed on clinical practice. Although attendance 
reported at these conferences is estimated at some 950 per conference, 
one of the principal concerns of the association la whether or not the 
conference is actually reaching the desired target group, the clinical 
practitioners. A study in 1967 revealed that the majority of 
ERJC participants were teachers and administrators (105) • 



198 



nurses; and 4) to provide information to nurses regarding various 
alternatives for professional advancement through formal education 
(95), (7). (105), (86). 

In addition to the foregoing, the Canadian Nurses* Association 
(CNA) provides a " ervice on nursing publications, while 

the two major associations in the United States offer for rent or 
purchase various teaching aides and resources. More recently, the 
National League for Nursing (NLN) Is reported developing programmed 
instruction on various aspects of clinical nursing (118). 

In 1967, the American Nurses Association (ANA) received a 
$50,000 federal grant to promote a nation-wide program of refresher 
courses to encourage a target of 30,000 Inactive nurses to return to 
nursing within one year. The Association's primary role In this 
venture was to identify inactive nurses and to involve agencies, 
particularly state nursing associations, in the provision of the courses. 
As part of its responsibility^ the ANA designed a set of guidelines and 
a model course which was subsequently published (32) . Since this 
original drive, further grants have been made to tacpand the ANA*s 
promotional efforts (13) . 

For the past decade the ANA has been sponsoring three day 
regional conferences focussed on clinical practice. Although attendance 
reported at these conferences is estimated at some 950 per conference^ 
one of the principal coucerns of the association is whether or not the 
conference is actually reaching the desired target group, the clinical 
practitioners. A study in 1967 revealed that the majority of 
ERXC participants were teachers and administrators (105) « 



199 

The ifc^jor contribution of the CNA is an extension course on 
Nursing Unit Administration which it has co-sponsored for a number of 
years with the Canadian Hospital Association. Designed to combine 
correspondence study with a workshop, this is offered nationwide to nurses 
employed in supervisory positions • Generally considered a highly success- 
ful program, Goldfarb (46) reported that in the first four years of 
its existence over 1,500 head nurses, supervisors, and directors of 
nursing had completed the course. 

All three national associations in co-operation with various 
specialty and local groups offer conferences and workshops relative to 
continuing education for nurses (25), (118), (105). A major concern of 
the national nursing association at present Is the establishment of 
guidelines and policies governing the expanding role of the nurse (20) , 
(9). As the health professions move towards "relicensure" the develop- 
ment of standards for continuing education and a greater effort to 
increase the number of available learning opportunities for practising 
nurses (105) will require national attention. 

This search of the literature yielded little on the activities 
in continuing education of state, provincial, and local nursing assoc- 
iations. Recent annual reports from university schools of nursing 
suggest that nursing associations are working more closely with the 
university schools of nursing both In planning and implementing programs 
of continuing education at the local level. Their influence Is also 
expressed in other ways, notably through the provision of funds for program 
development, studies of learning needs, and their role relative to nursing 
standards and practices (100), (115), (25). 
Hospital s 

Q . 

^ Although there are no detailed studies on Inservlce education. 
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the evidence available suggests that its development has been quite 
limited. One survey of inservice education in nine hospitals reported 
as part of a national study on the quality of nursing service in 
Canada (95) revealed that in all nine hospitals studied » orientation 
to the ward situation was the responsibility of the head nurse and her 
staff. In a few instances this program was planned to last several 
days or weeks with conferences, classes, and demonstrations in the 
afternoons. Three hospitals had a designated inservice educator and 
tended to offer the more comprehensive programs with more consistent 
follow-up for each new employee. One major weakness of most orientation 
programs was the lack of planned orientation to evening and night 
shifts. On several occasions nurses stated that they had been placed in 
charge of a ward on evening or nights without sufficient introduction to 
the administrative functions and procedures, as well as to the patients 
and their needs. In two instances nurses said they had to depend on 
nursing assistants and students to inform them of the policies, routines, 
and responsibilities of various personnel. 

In all but one of the hospitals surveyed, planned inservice 
education programs were provided. However, most of the programs 
focussed on disease entities, technical procedures, and new equipment, 
"even though observations and discussions suggested a need for inservice 
education oriented around the kinds of patients which nursing personnel 
indicated provided difficult nursing problems." Current literature was 
almost non-existent on most nursing units; however, one hospital 
reported circulating select periodica/*'. Most of the hospitals 
indicated that nurses were allorwed and in fact, encouraged to attend 
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various short courso. , workshops, or Institutes, conducted by nearby 
universities • 

The two major administrative problems emphasized by the nurses 
were: 1) the difficulty of releasing personnel to attend the programs; 
and 2) the difficulty of planning programs for evening and night staff • 
As stated by one respondent, "I think the afternoon and night staff 
should have some form of inservice program,, but you can't expect the 
night nurse to get up for an afternoon meeting". 

Many of the critical incidents provided over 1,000 registered 
nurses in Price's study (89) suggest that comparable problems exist in 
many American hospitals. This study emphasized that all personnel, 
whether full or part time, day, evening, or nights, should participate 
in inservice education and it recommended that scheduling be improved 
by the provision of an 'education day' for each nurse. "When inseirvice 
education is considered as essential, improvement in scheduling can and 
will be madeo This is recognized to be a task that is difficult, but not 
impossible". The report also recommended that inservice personnel work 
with nursing service to ensure that nurses not be assigned to a 
leadership role without previous orientation. 

In the Idaho Study (57), hospital based inservice education programs 
were found to be minimal, and much of what was being offered consisted 
of didactic presentations. Only six full time educational directors were 
employed in the fifty three hospitals and fifty four long term care 
facilities in that state. None of the directors had advanced education 
nor any additional training in the educational process. In fact, this 
study concluded that the educator's needs for continuing education were 
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similar to those of the nursing staff* These findings are not too 
different to those reported by Tif fney (109) , Murray (75) , and others 
(36), (92) • 

The national Commission on Nursing and Nursing Education (69) 
stimmarized its conclusion as follows : 

The entire committment to insBXvice education has been 
characterized by inadequate support: and insufficient personnel ♦ 
Of the more than 7,000 hospitials in the United States, for 
example, no more than 300 hsse a professional training specialist 
to direct their inservlce pregxams. All too frequently 
responsibility has devolved upon nursing service in the 
absence o£ any specific plan. 

Despite the disorganized state of the field, it is expected 
tiiat a number of recent developments will greaiJLy influence the future 
of inservice ediication» One of these is the recent stsitement by the 
Joint Commission on Accreditation which irould require tdaiiat nursing 
departments provide continuing education for imrsing personnel (82) . 
Although limiting in one sense, this reqolrement would provide greater 
support for inservice education. Another development concerns the 
educational media whdbch promise a partial solution to some aspects of 
the multi-faceted problem (17). Even more important Is. the Increasing 
trend towards the regionallzation of continuii^ educati^jn, which in turn 
is JEacilitating cooperative planning andlndeed^ in some ar*aas of pro- 
gramming, it is becoming Increasingly diffiactt to distinguish between 
"inservice" and "continuing" education.. 

Universities and Their Schools of Nursing ; 

Gwaltney surveyed (49) all colleges ^miL university schools of 
nursing in the United States. Thia study revealed that during the 
academic year ]^^8~69, 41 of the responding schools offered! 400 programs 
i9^Lth a range cn^ from 1 to 69 « In additli^n^ all ^ reBporftamtS! Indicated 
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some degree of participation in co-sponaoring courses, notably with 
voluntary health agencies, state nursing ass- iations, KMPS, and other 
colleges and universities. The length of the programs offered varied 
from one half to forty days. 

The Ohliger and Barratt survey (81) of 96 NLN accredited schools 
of nursing offering a baccalaureate but no higher degree suggests even 
less involvement of collegiate schools in continuing education. Of the 
62 schools responding, only 31 had offered a continuing education program 
during the academic year 1967-68. More specifically, 15 schools offered 
one continuing education program, 12 offered 2- to 5, and only 4 offered 
more than 5. These programs varied in length from one day to two weeks 
while in some cases a program was offered intermittently over a semester. 

The University of Toronto Survey (25) revealed that between 
1965 and 1968, four of the province's universities provided 19 courses for 
nurses. Of these, only 12 were sponsored or co-sponsored by schools of 
nursing. The others were offered by the faculty of medicine and the school 
of hygiene. The length of the nursing school programs ranged from two 
days to eight weeks . In the two national surveys , groups for whom programs 
were most often provided were general staff nurses, head nurses, super- 
visors, instructors, public health nurses, occupational health nurses, 
and private duty nurses, more or less in that order. 

In Gwaltney's survey, the schools indicated that the most 
frequent request was for management skills and to a lesser extent clinical 
nursing. Ohliger and Barratt reported the following content areas s 
nursing In public health, rehabilitation, maternal-child, medical-surgical, 
and mental health. More specifically, topics included: sex education 
and. family life, principles of management and supervision, sensitivity 
O trraining, head nurse roles, le^al problems in nursing, teaching methods, 
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problem-solving and nursing practice, and mental retardation, 

A review of recent program descriptions suggests that in addition 
to the foregoing, university schools of nursing are also offering an 
appreciable number of refresher courses for inactive nurses C22) , (21) , 
(114). The literature also suggests that more consideration is being 
given to sequentially planned clinically oriented courses, particularly 
to the areas of intensive care (17) and leadership development (38) ^ 
(39), (40). In addition, a few universities are reported offering 
certificate courses designed to expand the role of the nurse in the 
area c£ ambulatory care (114) , (85) . 

On the whole, cc?mprehensive programs with long range goals 
appear to be the exception rather than the rule. As in all the health 
professions, the great majority of programs in continuing nursing 
education are short courses, designed to meet the iimnedlate needs of 
nurse practitioners and/or the employing agencies (18) , (116) , (48) . 

ADMINISTRATION 

Although administrative arrangements vary, the majority of 
continuing educ^ition T>rograms are administered as part of the univer- 
sities* schools of nursing. A few, however, exist as separate divisions 
but within the health science complex (49) . the University of 

Wisconsin, continuing nursing education is organized as a separate 
department within the extension division. To ensure co-ordination with 
the school of nursing, the administrators in extension are also on the 
faculty of the school. In keeping with the extension concept, courses 
In nursing are offered throughout the state using a variety of admin- - 
Is tratlve arrangements (26). The University of Colorado's continuing 
^^icatlon service has a state advisory committee made up of represent- 
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atlves erom various fields of nursing an* allied health professions. The 
role of this co-lttee Is to serve as a means o£ co-nunlcatlon relative t, 
continuing education needs, and as a liaison hetween the school of nursing 

and health agencies (115). 

Gwoitney (49) disclosed that the majority of reporting schools 
employed full time directors of continuing education for nurses. Of 
these, 27 directors held master's degrees. 4 held doctoral degrees, and 
one had a baccalaureate. Additional nurse faculty engaged full time ragged 
from 3 to 23. „„at of these held master's degrees . Ohllgerand 
Barratt (81) reported that 7 of the 31 responding schools reported that 
persons responsible for the program had some additional preparation In 

adult education. 
Instructors 

The nursing schools reported the use of both regular faculty ana 
outside people to teach continuing education programs. These latter 
included: public health personnel, nurse clinicians, physicians, physical 
therapists, sociologists, psychologists, social workers, pharmacists, 
attorneys, and television programmers (81). Most schools also report the 
■ „se of local nurses as resource persons and/or teachers (92). Some schools 
report the use of patients and families as Important and effective resource 

persons (100) (79). 

The recruitment of faculty, expert both In the field of nursing and 
the psychology of adult learning, has been Identified as one of the major 
problems In selection of teachers (100). (90). Another Is the heavy 
responsibilities which the regular faculty carry In the undergraduate 
and graduate programs. The policies of s«.e universities prohibiting 
payment to faculty members participating continuing ed™=atlon programs 
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is said to further aggravate the situation (92) • 

Recent literature suggests that many university schools of 
nursing are attempting to meet the acute shortage of skilled adult 
educators through intensive training courses for nurse faculty, 
inservice coordinators, and public health nurses (38), (39), (40), (41). 
In el^ition, at leas't 2 RMPS have engaged full time personnel to assist 
inservice educators to improve their programs and to prepare local 
nurses to plan and implement programs of Inservice education (24). 
Finances : 

As in the other health professions, continuing education in 
nursing has been the recipient of grants from the Kellogg Foundation 
(115), (100), (19). Other sources of funds include donations, course 
fees, professional associations, employing agencies, and government 
grants (27), (115), (66). University schools of nursing in the United 
States appear to be in a much more enviable position than those in 
Canada. In fact to date, medicine and nursing have received the lion's 
share of funding for continuing education through public law 89-239 
(23). 

Other lucrative sources of revenue in the United States have 
been the federal short term training grants through the Manpower Train- 
ing Act (66) , the NIMH (National Institute of Mental Health) grants 
(119), and the twelve month grants through the U.S. Public Health 
Service, Division of Nursing (83). Despite such a diversity of sources 
in the United States as in Canada funding Is said to be inadequate 
(116) , (90) . The main problem seems to be a shortage of funds for 
continuing education which requires a secure financial base. In fact, 
the pace setting schools of nursing appear to be those which have had 
§^^i8lderable financial support from the university (115) , (26). 
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Publicity and Promotion i 

The promotion of continuing nursing education is achieved through 
the usual brochures, nursing association newsletters, newspapers, and 
nursing journals. Of these standard methods, the Wisconsin study (28) 
found that brochures and fliers sent to hospitals and other eraploying. 
agencies were the most effective means of reaching nurse practitioners. 

In order to facilitate advanced planning by the employing agencies 
and nurse practitioners, some universities are publicizing their program 
offerings once a year in the form of calendars (18), (114), (100). Since 
January 1971. the Journal of Co ntinuing Education in Nursing has included 
an "Educational Opportunities" section as a further aid to those nurses 
interested in attending programs both within and without their state. 

As in dentistry, it is not unusual for course sponsors to offer 
credits or certificates for course attendance. In Gwaltney's sutvey (49). 
7 schools of nursing reported offering credits while 25 did not. Credit 
was used most often by schools offering extension work in some courses 
unrelated to degrees. 
Program Planning ; 

Most of the university schools of nursing use permanent or rotating 

committees to assist with the overall planning. Committee members 
usually consist of both school faculty and outside resource persons. In 
•addition, special committees are organized to plan individual program 
offerings (115) . The personnel in these planning groups are selected on 
the basis of their expertise and interest In the particular program being 
planned (100) . (115) . Reports on inservlce education suggest that most 
programs use coiomittees for planning (45). (42), (87). In the CNA survey 
(95) it was found that general staff nurses and nursing assistants in some 



208 



hospitals each appointed committees to plan programs for their own groups. 

As in medicine and dentistry » nursing appears to make extensive 

use of participants' oplnlonnalres as a basis for program planning. 

However, as in most fields of adult education, these surveys do not 

identify the participants' real learning needr (^K^. Straub (107) 

found that even when the nurses selected the r.o. ■ sint, helped plan the 

program, and had time provided so that they could attend, more than one 

quarter of the nurses did not attend the majority of the meetings. She 

also observed that attendance was much lower for those meetings devoted 

to nursing care and Interdisciplinary matters. Straub asks: 

Should the content for inservlce education programs be 
determined by the nurse practitioners? Or should additional 
topics be suggested by people in leadership positions 
such as the head nurse, supervisor, and director of nursing 
service? Persons in these positions might have a 
different concept of the needs of nursing personnel 
because of their postions, experience, education and 
the like? 

Grosicki (A7) surveyed needs in one Veterans' Administration 
Hospital and found that while many different viewpoints had been in- 
corporated into the carefully planned programs, most of the activities 
met the Immediate needs of the situation, but were lacking in continuity 
and overall program goals. Primary emphasis had been placed on 
functional competence, particularly the efficient management of the 
unit, and "this area showed the greatest increment of application. In 
other subject areas, very little of what had supposedly been learned 
had been put into clinical practice. The greatest deficit appeared 
in clinical competence." 

In a similar vein at thfi Williamsburg conference (90) It 
was agreed that the two most serious deficiencies in continuing 

education were: 1) the lack of continuity between knowledge and its 

O 
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needs. More recently, under the auspices of the WICHErMSRMP, the Committee 

of Continuing Education for Nurses in Idaho (120) has drawn up a proposed 

program based on the philisophy expressed by Miller : 

It would seem that the time has come to try a different 
educational model .... one built upon solid evidence about 
the way adults learn, rather than upon the time honored 
methods of teaching them. There is ample evidence to 
support the view that adult learning is not most 
efficiently achieved through systematic subject instruction, 
it is accomplished by involving learners in identifying 
problems and seeking ways to solve them 

In keeping with this philosophy, this program will be 
introduced in phases with the major emphasis during the first phase on 
the learning process. Group meetings in the clinical areas will be 
utilized with active involvement of the participants in analyzing and 
determining their own learning needs, and with instructors available who 
will be working with several groups simultaneously. Content material will 
be provided as the groups are ready for it. Existing resources will be 
used as required. Several instructional processes will be used in 
response to the needs expressed by the participants. As the programs 
develop they will be regionalized and ultimately integrated with continuing 
education programs for physicians and allied health professionals. 

Continuous evaluation will be built into these programs through 
the use of objectives stated in behavioural terms. Participants, faculty, 
and the agencies where nurses are employed will participate in the 
evaluation of the project. More specifically, the evaluation will attempt 
Q to: 1) appraise the participants' ability to identify their own 

educational needs and to establish goals for sustained 'self education' 
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the quality of patient care has improved and to what extent the 
facilities support continuation of the program, and 3) a general 
analysis by the faculty of the co-operative approach to continuing 
education and its value to participants and their employing agencies. 

SOME SAMPLE PROGRAMS 
It is difficult to generalize about the Instructional 
processes currently used in continuing nursing education. Nevertheless, 
a perusal of recent program descriptions suggests that a high premium 
is placed on small group discussion, hence it is not unusual for 
university schools of nursing to control enrollment, both in terms of 
numbers and according to such variables as area of specialization, 
position in the employing agency, and on occasion, years of experience 
(38) , (39) , (40) , (41) . The most promising approaches appear to be 
those which have managed to combine the classroom instruction with 
clinical practice. 

Regional and Sub-Regional Programs: 

In 1957, the Western Commission on Higher Education in 
Nursing (WCHEN) launched a centrally planned, regionally implemented 
leadership training program. for nurses already employed in key positions. 
Financed by the Kellogg Foundation, the primary objective was "to aid 
the participants to become more effective leaders thereby improving 
patient care". 

Several features distinguished this course from other 
previous efforts. It was scheduled on an intermittent basis, con- 
sisting of one week conferences separated by 3 to 6 months intervals 
O £xtendtng over three years. During the Interim periods the participants 
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returned to their work settings to apply what they had Learned, with 
consultation services available as requested. In this way nurses who 
ordinarily would not have been able to engage in further education were 
able to do so. Another aspect of this progrsm particularly conducive 
to learning was the ±n-residence conference wi^iich took participants 
away from the work settings where they could freely exchange Ideas and 
progress notes on problems in their home situations. Encouraged by the 
favourable response to this experiment, a grant was received from the 
Public Health Service, and the program continued (29). 

Since the initial project, various alterations have been made 
In the program with the time span reduced to two years and, in some cases, 
one year. Techniques of Instruction now include lectures, panels, small 
group discussions, and clinical experiences. To facilitate the applic- 
ation of new learnings, each participant selects some area of work in 
which she wishes to bring about change which she undertakes as a take- 
home assignment. These are discussed at the initial session and progress 
notes reviewed at subsequent sessions , both individually and in groups 
(68). Continuing evaluations have utilized a variety of techniques 
Including observations of simulated nurse-patient situations, analysis 
of process recordings and diaries, rating achievement of course 
objectives, satisfaction ratings such as the Kropp-Vemer scale, and 
Firo-B, which Is a measure of group compatabillty (31). This program 
design is widely used in continuing nursing education. Most of the 
programs reviewed or mentioned In this section are replicas or modific- 
ations of the original WCHEN model. 

Despite its successful application, and the high regard with 
ERJC which the WCHEN leadership programs are viewed, success has been difficult 
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to measure in terms of behavioural change. Between 1962 and 196Ay eight 
WCHEN progra'ds were objectively evaluated t&elng a variety of paper 
and pencil tests » scaled ratings of observed nurse-^patlent situations , 
and employer-employee ratings on the job. Four hundred and ten course 
participants and 450 non-course participants were examined on their 
before and after interpersonal relationships as well as other changes 
in behaviour. Although the evaluation found that the course signific- 
antly influenced participant attitudes and beliefs, no firm conclusions 
could be drawn with respect to actual changes in behaviour (60) » 
An earlier, albeit less well designed study by Todd (110) disclosed 
similar findings. 

Using the WCHEN pattern, the Texas League of Nursing sponsored 
a similar series of regional conferences for management personnel 
between 1960 and 1964. An evaluation of this series revealed findings 
consistent with those of the WCHEN studies. In brief, although the 
participants appeared to adopt a more democratic and understanding 
attitude, there was little conclusive evidence to suggest a change 
in job performance (72). 

Commenting on the WCHEN findings, Ingmire (60) raises a 

number of crucial questions: 

How can the quality of nursing care be measured? What 
other instruments can be developed to measure nurse 
behaviours in the work setting? How can participants for 
future programs be selected who have the greatest potential 
for personal growth? How can the participants' learnings 
be extended into institutional systems more effectively? 
How can institutional administrators and colleagues of 
related disciplines be more closely Involved In this or 
similar programs? 

In an effort to tackle the multi-faceted problem of the 
,9^ititutional climate » Ingmire and her colleagues at: the t&ilverslty of 
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California have extendaEd iHa WCHExN leadership focus to many of their 
continuing education progr^s. Inc.aire and Blansfisld <59) have recently 
described one such progxam ^n whicifa hospital administrators, directors of 
nursing, and deans of schooll? of Trorslng enrolled as teams "to learn new 
and revised theories of t^sm builciing ati i to consider ways in which theae 
theories could be applied JLn the back-home setting". The program con- 
sisted of three day conferences meeting three times over a one year period, 
which provided the teams an opportunity to utilize and reinforce 
conference learnings. The training laboratory or "T" group approach 
was used with theoretical material presented as needed but mainly to 
provide a focus for discussion and interaction among participants. 

An evaluation of the program was conducted in two ways: 1> partic- 
ipants' perceptions of change in themselves and in their relationships 
with others; and 2> faculty's perceptions of change in the participants' 
method of interacting during the course of the sessions. Of the 39 
participants ^-ho completed the first series of conferences, 27 responded 
to a questionnaire and the most frequently reported behavioural changes 
were Increased understanding of themselves and others, and more open 
relationships. Of the reported changes In organization and management 
processes. Improved meetings was mentioned most often. The most 
tangible evidence of the success of the course was the participants' request 
for an advanced training laboratory which has subsequently been implemented 
with high enrollment reported. 

Brown (16) has reponted a^three year pilot project::lji which teams 
of Instructors and BmpecvSBovs m^TB enrolled for a. course on cancer nurslnc. 
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Co-sponsored by the Southern Regional Education Board (SREB) and the 
University of Texas, this course consisted of three conference sessions 
extending over a one year period. The major emphasis was on the nursing 
care of patients and families • The sessions also stressed and demon- 
strated the multi-disciplinary approach. One of the major take home 
projects was the development of a plan for extending the knowledge and 
skills participants had acquired to other nurses in the back home setting • 

Although well conceived, Brown reports that many difficulties 
ensued in the implementation of the program. Because this type of an 
educational experience was so new to most of the participants, and 
because they had such varied backgrounds. Instruction had to be provided 
on an individual basis frequently. The greatest problem related to those 
assignments requiring participants to engage in direct nursing care. 
Both the Instructor and supervisor participants were found to be 
psychologically insecure and reluctant to communicate with patients and 
families. 

Truscott and Keller (112) have described an interdisciplinary 
program in use in the North Carolina RMP stroke program. This four day 
course is offered in two day units with a week in between. Content 
identified as pertinent to all participants, physicians, nurses » physical 
therapists, speech therapists, occupational therapists, and medical social 
wprkers. Is presented through joint session. Instruction includes 
lectures and discussions supplemented by slides, films and filmstrips. 
Also provided is a loose-leaf notebook with review notes pertinent to 
each discipline. Four such courses have been completed with an attend*^ 
ance of 154 professional health workers. As a result of this experiment 



215 



It Is felt that the basic core content has been Identified and that the 
participants are developing a better understanding of the meaning of 
rehabilitation and their Interrelated roles in the management of the 
stroke patient. 

Truscott and Keller (112) reported that great gaps were found to 
exist in the participants' knowledge of the care of the stroke patient 
which posed a real problem as did the associated unlearning which was 
necessary in some instances. Although participants were identified as a 
"stroke team"> the team concept as an approach to care was often not under- 
stood or implemented* In joint sessions , physicians were reported 
hesitant to ask questions because nurses were present , and nurses were 
equally reluctant to expose gaps in their knowledge. Some participants 
were facility rather than discipline oriented in that their interest in 
stroke patient care was limited to its application in their own part- 
icular type of facility • Thus public health nurses were not interested 
in acute nursing care and nurses employed in acute hospitals were not 
interested in the community aspects. Similarly, participants from small 
rural communities were not interested in hearing or discussing facilities 
which were not available in their own home settings. Generally speaking, 
"Health practitioners were more interested in the "how to" rather than 
the "why" or the philosphy of care". 

In a recent article, Conley and Larson (24) report that the 
Colorado RMP and the School of Nursing are offering an interdisciplinary 
course in Rehabilitation and Maintenance. This program is intended to 
develop skills needed for "post crisis" patients and It is offered in 
small rural communities throughout the -region. Local planning committees 
composed of representatives from nursing and the allied health professions 
Identify educational needs and develop the program with the assistance of 
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university faculty. Local health personnel are utilized as Instructors 
with the university providing assistance as necessary • The course is 
highly individualized in terms of local needs and the needs of partic- 
ipants as well. Scheduled on an intermittent basis » the program consists 
of three 3-day conference sessions. Following the initial session » 
the participant selects a patient for whom she develops a nursing care 
plan. In the period between the second and third sessions she is asked 
to develop a teaching program for her selected patient. Instructors 
provide individual guidance to students throughout and each is encouraged 
to proceed at her own pace. 

Conley and Larson (24) also report that the Western Pennsyl- 
vania RMP and the Graduate School of Public Health at the University of 
Pittsburgh are conducting a program for the long term training of nursing 
home personnel, using both university and in-patient facilities. The 
course consists of weekly sessions lasting one day for a nine month period* 
Formal presentations are minimized in preference to problem-solving.. 
Where possible administrators and charge nurses have classes together. 
Following the completion of the program the participants are provided with 
consultation services by the faculty for a two year period. 

According to Conley and Larson » the effectiveness of this course 
is demonstrated in the patient care facilities to which the graduates have 
returned. They cite new and improved nursing procedures that have been 
instituted in the home facilities, the establishment of positions for both 
a director and an inservice educator; job descriptions and performance 
evaluations for nurses have been developedj and inservice programs have been 
^-Implemented in a nismber of facilities. 
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The MSRMP (Nevada) is using a Consulting Team approach to 
contintuing education for health service personnel in rural communities in 
Nevada. The core of the consulting team consists of physicians and nurses 
with ocher health professions serving as resources where their skills are 
required. A bi-monthly schedule of visits provides consulting service to 
local communities. The program for each visit is baaed upon the identified 
needs of the community and is developed co-operatively with the health 
personnel in each area to be visited. Thus the team may provide either 

\ 

structured courses or unstructured consultation depending on the need. 

The ever increasing demand for nurses with specialized skills 
in intensive care nursing, and more particularly, coronary care, has 
resulted in a great proliferation of short courses in this area of nursing. 
Of the many program descriptions reviewed, the one sponsored by the 
Colorado-Wyoming EMP and the University of Colorado School of Nursing 
(114) is probably the most comprehensive and well integrated. Scheduled 
on an intermittent basis, the initial two week session consists of lectures 
self study, and practical experience followed by a six week interim in 
the participant's own work setting. During this period the trainee 
completes a special assignment "which involves identifying a problem in 
her clinical setting about which she develops a research-type project 
directed toward a solution". The second two week in-training session 
places coi-tirlder able emphasis on clinical experience which is largely 
Individualized to meet the individual's own particular employment needs* 
The last two days are devoted to management and co-operation between 
health personnel in clinical settings. For this last session, participants 
are encouraged to Invite directors of nurses , hospital board members , 
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hospital administrators, or others of her choice from the home hospital. 
Thereafter, a one week follow-up session each year is available to ensure 
the necessary updating of information and an evaluation of the program's 
effectiveness. Concurrently, the University of Colorado is offering a 
course on the intensive nursing care of children as a companion to the 
course on intensive care of adults. The sessions are conducted together 
where the two courses have material in common. In addition to the 
behavioural and physiological aspects of nursing care, this course 
emphasizes the nurse's role with the total family group and the team 
approach to patient care in the intensive care unit. 
Inservice Education : 

Del Buemo et al (33) described a special orientation unit with 
its own instructor and a head nurse particularly responsive to the needs 
of staff at the Presbyterian Hospital in New York. New staff members "are 
rotated through this unit to receive necessary instruction and experience 
on all three shifts under the guidance of an instructor or charge nurse. 
Although it is too early to evaluate the overall effects of this plan, 
it is thought that this program will help ultimately in decreasing the 
high turnover rate of nursing staff. 

At Peter Bigham Hospital in Boston (103) , nurses with less than 
six months experience are being rotated through two clinical specialties 
following a six month period in medical surgical nursing. Programs of 
inservice education are provided concurrently with these new experiences. 
In spite of the difficulties in implementing such an ambitious plan, the 
advantages are felt to be: 1) the nurse received a year of planned 
experiences during which time she has the opportunity to consolidate 
her medical surgical nursing skills and to sample two kinds of specialized 
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nursing; 2) there is evidence of increased morale among the nurses: 
and 3) nurses are available to relieve in specialties when necessary. 

At the University of Rochester's Strong Memorial Hospital (70) > 
instructors have been assigned to each of the major clinical services which 
has made possible unit based clinically oriented inservice education 
and more individualized orientation programs. On the first day each 
newcomer completes a questionnaire which asks about past experiences 
and felt learning needs. Through an analysis of the information 
gleaned from the survey an individualized clinical orientation is then 
provided as part of the overall program, 

Wilkinson (121) has reported an experiment in orientation at the 
Langley Porter Neuropsychiatric Institute of the University of California 
in which new psychiatric nurses engage in self -orientation. In this 
experimental project, the environment was structured to make available 
selected learning opportunities and the nurses were informed about them 
but no attempt was made for structured learning activities. The only 
specific requests made of the new staff member was that they tape a 
report at the end of each day which was a resume of the day's activities, 
and they were asked to inform the school when they terminated this 
self orientation. Findings revealed that the orientation was highly 
individuals with no two nurses proceeding in the same manner yet all 
of them Involved themselves in those activities which they considered 
significant to their orientation. From the tape recordings it was 
apparent that as the days progressed , the nurses became increasingly 
aware of what they must learn in order to function as well as others. 
This procedure was identified as the "self identification of continuing 
learning needs**- 
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At the Loeb Center for Nursing and Rehabilitation in 
Montefiore, New York (3), the new nurse is assigned directly to. the unit 
to work with a staff member who is thus available to her for help as 
she identifies a need or expresses an interest. Opportunities for 
conference are also available where she may receive clarification on 
matters of policy and/or procedures. Through this program the newcomer 
is encouraged to identify her own need for help and is given the time 
to plan her own orientation. The inservice education program at the 
Loeb Center is probably one of the best examples of how continuing nursing 
education can be built into day to day practice. Staff conferences 
scheduled once a week for all nurses involved in the program provide 
opportunities for group discussions about ways to facilitate care and to 
clarify varying types of problems which nurses identify as interfering 
with their work with patients. Unit conferences are held as the need 
arises and nurse to nurse reports from day to evening shifts are described 
as "conferring, planning sessions", rather than the usual recitation of 
activities. 

Regularly planned conferences and teaching on the wards also 
typify much of the inservice education at Rancho Los Amigos Rehabilitation 
Center in Los Angeles (16), In addition, workshops on rehabilitation 
nursing are also scheduled regularly. These courses are available to nurses 
from general hospitals, special long term hospitals, nursing homes, 
visiting nuraes asaoclations, and public health agencies, as well as the 
staff at Rancho Los Amigos, Interdisciplinary in approach, some of the 
sessions include selected patients who present pertinent aspects of their 
Q case histories and discuss their perceptions of the treatment process, . 
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Of the growing number of programs preparing pediatric nurses, 
the one at Bunker Hill Health Center in Massachusetts (11) best fits the 
definition of continuing education used in this report, hence a des- 
cription of this program is provided as an example of an innovative 
program designed to expand the role of the nurse. In 1968 a sixteen 
week program was started which allowed a nurse to continue her regular 
schedule but with a minimum of one and a half days per week release time 
for the duration cf the course* Admission requirements were: 1) that 
the nurse trainee already hold a job or have promise of a job with a 
practitioner who provided pediatric care for all children in the family; 
2) each trainee be guaranteed the opportunity by her employee to function 
in an expanded role in her work setting; 3) on the job training be 
provided by a qualified pediatrician during the course; and 4) opport- 
unity for on the job training be assured following completion of the 
program. No special educational qualifications were required other 
than successful graduation from an accredited school of nursing. 

The course was divided into 94 hours of classroom instruction, 
and 96 hours of clinical practice in a variety of in-patient and 
pediatric ambulatory settings. Clinical practice also Included 
specially arranged experiences in the nurse *s own work setting under 
the preceptorship of the pediatrician and the supervision of the 
Center's nursing faculty. Through seminars and individual supervision, 
the following factors were emphasized: 1) the decision-making process 
2) conflict and anxiety in role re-orientation; 3> team work and inter*- 
personal relationships; and 4) the problems of delivery of health 
services to children and their families* 
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Since the first two courses were considered experimental, no 
atteD?pt was made t^ make an objective evaluation, however, certain personal- 
professional characteristics were tabulated. This disclosed that roughly 
one half of the participants had a diploma, approximately one third a 
baccalaureate, and five had a master's degrees. About one half had had 
no prior pediatric or public health nursing experience, and most of the 
rest had less than five years experience in either field. In short, 
they were a relatively inexperienced and youthful group. Concerning 
these data, the authors note: "In our experience nursing education 
background has had no relationship whatsoever to successful and satis- 
fying function in the role of pediatric nurse pr^sctitioner . The same 
can be said of age, marital status, and number of children" ; They do 
point out that certain areas of content were weaky notably child growth 
and development .^nd knowledge of common pediatric problems. They also 
felt that more time was required for the nurses to work through the 
problem of conflict and anxiety related to role re-orientation. This 
program has recently become associated with North Eastern University, 
which, according to Brown (16) "should provide the depth required to 
develop the kind of leadership needed to change the health care system". 

Mass Media and Self Instructional Methods : 

Since the completion of the statewide educational television 
network in Kentucky, along with the other health professions, nursing has 
been presenting programs on PANNED, and interprofessional television 
series i From November 1969 to November 1970, nursing presented eight 
programs in this series. A survey (14) based on 587 questionnaire 
responses (66 per cent of the registered nurses in Kentucky) disclosed 
that the majority of nurses watching the series were young graduates from 
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diploma programs working general duty in hospitals. The overall reaction 
to the programs was favourable, with many respondents indicating that they 
felt PANMED programs could be used by nurses to continue their education. 
The major criticism of the series was a lack of knowledge about the 
program. More specifically, 174 of those who did not watch any of the 
aeries indicated that they did not know it was to be shown, and another 
33 "thought it was a refresher course for nurses". The second major 
complaint expressed by those who watched was that the reception was poor, 
with 98 reporting that they were unable to get the series. 

On the basis of these findings, it was recommended that the 
series be continued, but that some method for evaluating its effectiveness 
be instituted. It was also recommended that the series be advertised 
better, and that it be shown at an earlier time. It was further - 
suggested that the programs be made available through closed circuit 
television in the public colleges; "These could then serve as centers 
for feedback and evaluation of some of the programs offered". 

Abbey e£ al (1) reported an experiment using open circuit 
television in which they sought to determine whether nurses gained more 
from a broadcast viewed individually at home or from one viewed with a 
group of colleagues in a hospital conference room. They also attempted 
to identify those conditions which enhanced learning compared with con- 
ventional broadcasts which require no active participation. In this 
experiment, three response conditions were used: 1) the control 
condition or conventional broadcast presentation; 2) experimental 
conditions consisting of a "covert" presentation in which questions were 
inserted into the broadcast with students encouraged to think of the 
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students were rewarded for making a written response to the questions 
by being provided with knowledge of results by return mail. Participants 
included 120 general staff nurses drawn from each of three geograph- 
ically separated cities which participated in the study. In each city, 
20 respondents viewed the offerings individually at home, and 20 did 

so in a group setting. 

The program was sponsored by the University of California 
School of Nursing as a tuition course which carried a certificate of 
completion. Learning achievement was measured by a sixty item multiple 
choice test, while attendance was measured in two ways: 1) subjects 
who completed the course indicated on a special form which programs they 
had viewed; and 2) actual attendance of subjects in the hospital setting 
was recorded for each broadcast. The findings revealed no significant 
difference in regularity of viewing and completion of the course 
according to presentation response conditions. Although the results on 
the presentation response conditions were statistically inconclusive as 
measured by test results, home viewing wa. found superior to group 
viewing as measured by learning achievement. The report concludes: 

If only group viewing at central location were effective, 
broadcast television would have limited instructional 
potential. The findings of this study i^^^^^f ^» 
that through home viewing, broadcast television has the 
potential to serve all health science professionals, 
including those in which members spend their working 
day separated from each other". 

For the past several years the University of California School 
of. Nursing in Los Angeles has been offering televized programs via the 
scrambled network system. The series is presented on the Medical Tele- 
vision Network to 70 member hospitals. Nurse co-ordlnators in eacb of the 
O - ospltals are assigned responsibility for publicizing the programs, 
i^rganlzlng the viewing facilities and introducing and conducting a 
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fifteen to twenty minute discussion following the program. Approximately 
13,000 nurses and members of other health disciplines are reported to 
have viewed the series. 

The programs are patient centered and frequent?.y have used 
actual patients as well as health personnel with emphasis on demonstration. 
Squalres (106) identified the major problems encountered in the first 
five years of the program: 1) poor selection of program chairman; 
2) too much content; 3) not enough depth in content; 3) no permanent 
staff; 4) no money for Implementing programs as part of the continuum 
of continuing education offerings. She also reports that portable 
equipment is being taken into the field for live conferences and that 
this approach has been found effective in developing counselling inter*- 
viewing techniques. 

The Ohio State University School. of Nursing and the Department 
of Nursing Services of the Ohio State University Hospitals (80) are 
broadcasting two-way radio telephone programs to 48 of the state hospitals 
to enable scattered audiences to participate in programs of continuing 
uursing education. Attendance is reported to have increased from some 
2,000 during the pilot project in 1966 to over 10,500 for the 1969-70 
series. 

The programs consist of a lecture or panel presentation- followed 
by questions and comments from the participating hospitals through their 
moderators.' Each hospital is furnished a quantity of printed outlines 
and a set of 2 x 2 slides which are used in conjunction with the 
presentations. "Interest and enthusiasm" for the program Is said to be 
a motivating factor In the continuation and expansion of the series. 

■■■ ■■■■ : • ' -^/^'^--V' --'^ ■ ■■. i 
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In 1966 the University of Wisconsin (52) initiated the firi^t 
statewide telephone conference for nurses. Fashioned after the tele- 
lecutres developed for continuing medical education, this series was 
offered as a lecture followed by a question and answer period. The 12 
classes presented weekly were received at 2A centers located in various 
clinics and hospitals throughout the state* Co-ordinators assumed res- 
ponsibility for showing accompanying slides and serving as moderators. 
Since the original series » improvements in technology have made possible 
simultaneous transmission on FM radio. There are presently 56 tele- 
phone listening posts and 27 radio listening posts > with about 1000 
Wisconsin nurses participating in this weekly series. 

On the basis of a 20 percent return (N'-209) of evaluations 
for the 1967-68 series, Hornback (92) reported: 1) the majorltj^ of the 
participants were currently employed In nursing; 2) for approximately 
one half of the respondents the telephone conferences comprised the 
first continuing education program attended; 3) most respondents felt 
satisfied with the programs but many thought that there were too many. 

Since 1969 a special radio-telephone series has been offered 
for inactive nurses in order to help them keep up to date on gieixeral 
nursing knowledge. Funded by the Wisconsin RMFs, this series Is but 
one facet of the Wisconsin Inactive Nurse Service (WINS). Another is a 
project in which independent study guides are being developed on a 
number of topics requested by inactive nurses (2). Yet another innov*- 
ation pioneered by medicine and which nursing now shares is the dial 
access library (77) « Nursing Dial Access was initiated In 1969 after a 
four month trial period. It consists of a number of pre-recorded five 
to seven minute audio tapes on a variety of nursing subjects • The nurse 
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dials a speciai tsfi^hone number and asks for the tape she is interested 
in hearing. 'DBe usssxtd is then played for her over the telephone. The 
service is availaEle without charge to all Wisconsin marses. A. recently 
completed evaluation of the program found that more than one thousand 
calls are being received per month, with two-thirds of them between 
noon and midnight; nurses in more rural areas utilize the service more 
often than do their urban counterparts; hospitals, nursing homes, and 
schools of nursing make the greatest use of the program (104) . 

In view of the many problems confronting inservice education, 
it is surprising that greater use has not been made of the newer 
educational media and, more particularly, self instructional methods » 
The only innovative program reported was that described by Lindeman 
and Aernam (67), which was conducted at Luther Hospital in Wisconsin. 
Using a portable slide/sound projector, the nursing staff at this 
hospital are developing their own self-study packages on various 
nursing procedures. 

Dubin, Manaaw,. and Alderman (37) surveyed the use of coEres- 
pondeace courses JscliBBpitals . They found that hospital administrators 
and department head» in the United States generally lacked infornt&tion 
about this methodiand that it was; rarely used for inservice educaciron. 
On tsfe-other hand, SoffB±tal admiidiEEtxators in Canada were found to 
make fairly exten8li>W!i ase of correspondence courses for their employees. 
With the exception dS. the CNA-CHA Extension Course on Unit Administration, 
this review found no descriptive studies on its use in either country, 
and the same was true for programmed instruction. 
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RECURRING ISSUES AND TRENDS 

The Issues confronting nursing education are not too different from 

those facing medicine and dentistry; however, continuing nursing 

education Is faced with some unique problems related to the ambiguity 

surrounding nursing, as well as the need to'**upgrade the education of 

nurses who have graduated from programs which differ widely" (51), 

Adding to the confiislon has been the recent emphasis on the expanding role 

of the nurse- Nukoll (78) reported an analysis of a recent mailing from 

the American Academy of Pediatrics which found that 24 of the 34 training 

programs listed for pediatric personnel were designed to admit nurses* 

Of these^ only 6 required a B.S.N, degree for admission* The duration 

of the programs ranged from 16 weeks part-time to 18 months full-time 

culminating In a master^s degree. These data suggest that there is as • 

yet no consensus on the educational preparation of pediatric nurse 

practitioners* In the meantime, Hutchison (56) has warned: 

There is imminent threat of crash programs developing outside 
the educational mainstream. The preparation of the pediatric 
nurse associate falls squarely within the generally accepted 
scope of continuing education since the programs seek to 
further prepare the practitioner nurse. 

She urges that continuing education faculty ensure that the minimum 
standards outlined in the guidelines for Pediatric Nurse Associates be 
followed and that leadership be exerted to ensure that: fSoundL:programs 
develop under the sponisorship of university continuing: nursing and medical 
education. 

As noted earlier. Cooper (48) has expressed concern from another 

point of view. She queries whether short term courses preparing _ 

physicians* associates "will prevent a rapid and necessary Increase of 
Q narse specialists at the graduate level". Related to this problem is 
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the question" as to whether continuing nursing education should make 

special provision for the granting of credits toward college degrees In 

an effort to enable the vast number of experienced and capable nurses to 

obtain recognition for their clinical capabilities. On this Issue, 

Squalres (21) has advanced this view: 

Continuing education should facilitate, the passage from 
one level to another without lowering standards. This 
can be done by careful study and rer'deslgnlng::x)f curriculum. 
Keeping standards at the forefront but not alliowlng tradition 
to dominate, continuing education should be larvolved In 
the planning and provision of courses to mov^ people along 
the way. 

Even as these Issues are beginning to be seriously discussed by 
nurse leaders > nursing like all the health professions :is moving In the 
direct loiTi of mandatory continuing education as a reqtalsite for practice* 
In 1970, the California LegEslature passed a bill which specifies that 
after January 1, 1975, nurses aiid other health profess icanals will be 
required to submit proof tdnat during the preceding two years they have 
informed themselves of developments in their fields, either by successful 
completion of examinations, or by pursuing an approved course or courses 
of continuing education (63^. 

At the same time, nurse educators axe unaniiBxus in agreement 
that should mandatory contrlnulng educatilon be Implemar^red , colleges and 
universities could not.pniiduce the required courses at: present (51). 
Indeed, with the exception of a few universities and regional efforts to 
develop continuing education programs from the perspective of long range 
co-ordinated planning, continuing nursing education has been described 
as "unrelated, ad hoc measures, lacking continuity and follow up".(92). 
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CHAPTER X 
SUMMARY 

Registered nurses are the largest single group of health 
professionals. This group is made up largely of women, of whom well over 
one-half are married, and approximately one fourth of the group is 
employed part-time. There Is, a large inactive group of nurses, many of 
whom would be willing to re-enter the work force. Entry into the pro- 
fession is achieved through either a diploma or a degree program but the 
vast majority of nurses have no academic degree.. iSShere private duty 
nursing, was once the major field of employment, over 83 percettt of the 
employed nurses are iojw working in hospitals and nursing schools. 

The role of the nurse in patient care is in a state of flux 
with the new role nrat yet clearly defined. As it emerges, the trend is 
toward. expanded retfflponsibilltles both in general nursing duty and in 
spteciallzation. ThSs is creating new disnenslons to the knowledge required 
to perform new or moSified tasks in patient car& that results in the need 
for systematic leaxnctng at all levels within the profession. 

There have been four major developments in nursing over the past 
decade. These are: 1) a re-orientation of graduate nurses back to the 
bedside; 2) a trend toward clinical specialization; 3) an increased 
etfort to define nursing practice through research into patient care; and 

r 

4) changes in the reciprocal roles of physicians and nurses. Inservlce 
and continuing education have been identified as important vehicles for 
facilitating these trends, and Indeed, for solving many of the problems 
in nursing. 

While the identified learning needs relative the broader areas 
of nursing are not at all surprising, a number of studies Indicate that 
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nurses at all levels are insecure in their present positions and that they 
are concerned regarding their future in nursing. Furthermore^, idhe few 
studies which have attempted to determinie not only what nurses believe 
they need, hut also their real learning afeflciencies , suggest trtiar the 
learning needs of registered nurses are numierous and divexBs^ 

t&lle inservice education offexs the greatest pot:entii2l for the 
development of clinical competence, its poiiential has hardly besn 
touched. On the. other hand, although comtLnuing nursing educairlon at the 
university level Is in ita infancy, it i« faced with some ssctx^acEr^lnary 
demands, which the majority of schools cscBaxot cope with: :at pzresexct:, 
aeithex in terms of faculty, facilltiaass^ mnr finances . ^a^t is required, 
therefore., is a clearer delineation of ^^espective roles of the uniscersity 
schools, the employing agencies, and the professional associalriojis who 
are the three major sponsors of continuing: education in nuxsimg;. More 
specifically, in view of the evolving trenxie in nursing, itr^,wtmi3iii: seem 
that the university schools should focusii ran the development :ciEZIieadership 
and consultant services to the employing agencies rather than ifnvesting 
scarce resources In short course offerings which at best only a:erve to 
neet the pressing needs of the moment. 

Continuing nursing education should exert leadership in the 
ievelopment of new Instructional materials and program designs. As 
loted by Conley and Larsen (24) , most of the innovative programs In 
lursing funded through public law 89-*239 have been innovations in ' 
organization and administration rather than In educational design. 
Chis Is equally true with respect to most of the other Innovative 
urograms described above. 
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Joint planning and the co-ordination of resources at all levelfii 
are also indicated. In addition, the health professions might profitably- 
pool resources and v^ork togjgther In developing clinical programs, for 
ac amply demonstrated in th£s review, some of the most "successful" 
programs in nursing have been those which have been developed within taiee 
framework of a health team ^proach. 

In order that continuing education in nursing can achieve trtei 
learning and changes in behaviour that are required by the expanding rcEQs 
of the nurse in patient caxe, it is necessary that educational programs 
be developed that are functionally efficient as instruments for change. 
This can only be accomplished through the design and management of pro^^iuiiBit 
that are geared to adult learning • Among the several health prof essionffi,, 
nursing has been the first to accept the need for specialized skill and 
knowledge in adult education as a pre-requisite for educational planning** 
As this trend continues, it will provide the profession with a cadre 
of skilled educational specialists to ensure that continuing education 
programs will meet the need for learning in the progession* 
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CHAPTER XI 
THE PROFESSION AND CONTINUING EDUCATION 

The Individualistic nature of dental practice and its rel- 
ative isolation from the mainstream of general health services has 
several important implications for the development of continuing 
education. 

COMPOSITION AND DISTRIBUTION 

Like physicians 9 dentists are not being produced in suffi- 
cient numbers to maintain what is considered by some to be an 
optimum ratio of dentists to population (56) (42) . Despite efforts 
to expand dental school programs (56), population growth will con- 
tinue to outstrip the production of dentists* In Canada, an equally 
pessimistic dentist-population ratio is projected . for the years 
ahead (39) . Population ratios do not necessarily reflect an 
accurate picture of the availability of dental services. Studies 
have shown that the use of dental auxiliaries can significantly 
increase the productivity of dentists. In both Canada and the United 
States, governments recommend that dental auxiliaries be trained to 
perfom a greater ran;^e of duties than they are presently permitted 
to perform (42) (39). 

Another important factor Influencing the availability of 
dental services is the disproportionate distribution of dentists 
from region to region. As in medicine, the distribution of dentists 
in North America varies directly with the per capita income and the 
proportion of the population in urban communities • 

O : ■ ■ ■■" '■. • :.'■*: ^ ' ■ • 
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Thus, In the United States the highest dentist-population ratios are found in 
the large urban communities of the North East and the least in the South (42) . 
Similarly, in Canada the highest dentist population ratios exist in the large 
urban communities of British Columbia and Ontario and the least in Newfoundland 
(59). 

Although specialization has occurred within the dental profession, 
only a small proportion of dentists are practising a specialty. McFiirlanc^ 
(59) report«4 the^ in W62 only 3.8 percent cf the dentists in North America were 
practising a recognized specialty. While there are no recent national figures, 
a survey in Ontario found that only 6 percent of the dentists were in specialty 
practice in 1968 (74). Moreover, a report in 1965 by the American College 
of Dentistry revealed that less than 10 percent of graduating dentist^s were going 
to obtain graduate degrees or certification in one of the specialities of 
dentistry (68). Hence, while it is expected that specialization will increase 
appreciably in the future (66), it is not Aow a significant factor affecting 
the availability of dentists. 

Practice Arrangements : 

As in medicine, dentists also pool their facilities and personnel 
in order to meet the increasing demands on their services (59) (48) . There 
is also some evidence that hospita.il dentistry is increasing (35) (48) . Generally 
speaking, however, most dentists are still engaged in independent office 
practice (39) (43), and, as pointed out in the Report of the Committee on the 
Healing Arts, '^Because they are so independent , dentists may find it relatively 
difficult to keep up with the development of dental techniques, and they may 
not be as exposed to the kinds of quality controls that physicians experience 
through hospital and other control institutions required for the treatment of 
their patients" (74) . 
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Patterns of Work : 

Hall (39) noted that about one third of the 216 dentists 
interviewed worked a 40 to 44 hour week, for the rest, there was 
a wide variation from a high of 55 to a low of 35 hours per week. 
Of the 155 general practitioners in the sample, 54 percent had at 
least one full time dental asjsistSBS?::: wiiile ^9 percent of the 61 
specialists had one or more full time assistants. Only 6 percent 
of the total sample made any use of dental hygienists and 46 per- 
cent of those not employing hygienists felt the idea was a good 
one but knew little about the occupation or were not at aM 
enthusiastic about the re-organization 5ik»t mmld be TPajuir^ed to 
Introduce one into the office. 

The findings of the Ontario study (74) suggest that despite 
the growing importance of specialization and preventive oral medicine, 
most of the dentists' work is still "largely devoted t« re^^lne 
repair and replacement of dee^yed fcefeth, f toting dentures, and the 
treatment of common periodontal disease". According to this report, 
and implied in others (39) (59) (42), "The dental profession has not 
responded easily to changing public attitudes and needs, to new 
methods, or to the new ways of preparing dental personnel to provide 
these services"* 

Both from within affld iwAfhottt tt^; prof««»loa the proposal that 
continuing education be used as a vehicle for re-orienting dental 
personnel to overcome these deficiencies (72) is being advanced more 
and more frequently. More specifically, at a recent national work- 
shop sponsored by the American College of Dentists (72) it was 
recomiaended : 

1. That continuing education should not be limited to those 
subjects directly related to -dentistry r^^^^^^^^ 
that might have "spin off" benefits, e.g. , sociologically 
oriented courses to provide better understanding of the 
needs, fears, and desires of the underprivileged, as 
well as patient groups which require special care in 
their treatment such as the chronically ill, aged, and 

handicapped. 
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2. That dental societies, schools, and other agencies develop 
continuing education programs In keeping with the preventive 
concept of practice, regardless of the student group for 
whoTQ instruction is planned. 

3. That dental schools implement programs which will provide training 
in the management and administration of the total dental health 
team for the undergraduate as well as the continuing education 
student. 

Wttile these recommendations capsule the major areas requiring attention 
in future programs, planning must also take into account the opinions of the 
consumers of continuing education. Hence, in recent years, a number of surveys 
have been conducted in an effort to Identify dentists* perceptions of their 
leamtlig tiBeds. 



NEED FOR CONTINUING EDUCATION 



In dentistry the terms "graduate," "postgraduate," and ^'continuing" 
education have been defined by the Council on Dental Education of the American 
IJi^sMEsl ^Association (46) as follows : 

Graduate Education: refers to those programs which Include a 
planned sequence of courses leading to an advanced degree, such 
as a Master of Science, the Master of Science in Dentistry, or the 
Doctor of Philosophy. 

Postgraduate Education: refers to those programs >7hlch include a 
planned sequence of courses and instruction that do not lead to an 
advanced degree, but for which the student may be awarded a certificate. 

Continuing Educa^.i,oii: refers to those single courses of short 
duration (one or two days to several weeks on either a full time or 
intermittent basis), which are offered to provide practising dentists 
with Information about new developments in dental technics and the 
science of practice. 

Although these are the definitions generally endorsed by the dental 
profession, in practice the terms "continuing education" and "postgraduate 
education" are often used interchangeably resulting in considerable confusion. 

ERIC"; -^^^ . . 
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In order to present this report according to the terminology used 
by the Council, programs of full time study intended "primarily 
to prepare dentists for specialty practice and/or for teaching in 
a clinical area" (66), were defined as postgraduate education 
and r eluded from this review. On the other hand, since It appears 
to be common practice in dentistry to award certificates and/or 
credits for attendance at continuing education courses, "non- 
academic" credit courses were added to the foregoing Council *s 
definition of continuing education and included in this review. 

As a further clarification of terminology (12) it might be 
well to note that a continuation program in dental education includes 
the following: 

Seminars: A serainar is a group effort in study or research 
conducted under the leadership of one or more persons 
possessing special knowledge in the area of study. 

Study Clubs; A study club is an organized effort on the 
part of individuals to pool their knowledge and interest 
for the benefit of all participants. Study clubs may 
be of two kinds: 1) Where the objective is basically 
instructional, and 2) where the objective is basically 
investigative. 

Scientific Programs and Exhibits: Scientific programs 
are programs offered by organizations or institutions that 
offer lectures of discussions on various subjects of interest 
to the practitioners in an effort to keep the practitioners 
abreast of developments* Scientific exhibits offer further 
opportunity for this depending more on the visual aspects 
of the educational process. 

Extension Courses: Extension courses or programs offered 
by educational institutions are distinguished largely by 
the fact that they are made available outside the facilities 
of the school » such as a branch or by mall. 

Intramural Courses: Intramural courses or programs are 
those located in the universities* dental schools. 

According to most writeray continuing. dental educati^ con- 
stituted was a product, of the. second World Vfar^; (57) -(49) (55) (A) • Up to 
that time there appears^to, haye.bfeen few -attempts' to offer sy^ 
any- planned ^learning oppor tunitieaf cf oit dJentat ^ r r The return to 
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civilian life following World War II of a large number of dentists, coupled 
with the revolutionary advances in all the health sciences, forcibly demon- 
strated the need for specific programs for continuing dental education. 

In response to these needs, the W.K. Kellogg Foundation provided 
financial assistance to dental schools for the development of refresher-type 
program^, thus bringing the universities' dental schools into the mainstream 
of continuing dental education. A conference on continuing education was held 
in 1948 by seven dental schools which had been recipients of Foundation grants, 
and this appears to have been the- first of a number of national conferences 
and workshops which have been held subsequently to "study the problems related 
to the establishment and conducting of programs of continuing dental education" 
(55) (19) (91) (72), 

However, as noted by Mann (55) in 1964; 

Many of the 1948 problems remain, and totally satisfactory answers 
or solutions to them have not yet been developed. . .To-day , and 
probably more important than fifteen years ago, consideration must 
be given to the questions of what properly constitutes a total 
program of continuing education for the dental profession. What 
are the acceptable methods of continuing education that are or 
should be available within reasonable distance or expense? What 
can a dentist do by himself with journals or teaching devices, 
and what can be done by television? Should a total program have 
organization or should it depend upon Independent groups, agencies, 
and institutions to provide a sufficiently broad spectrum or 
potential experience to care for the profession's needs? If 
organization is desirable, who should administer it? 

These questions are still major concerns in continuing dental education 
today. In dentistry, as in all the health professions, there has been much 
discussion about these problems but few scientific studies on the ways and 
means of providing continuing education for dentists. 

Probably the most significant national study was that published in 
1960 by the Council on Education of the American Dental Association (46). It 
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provided a comprehensive report on the changing nature of dental 
practice, and on the general status of dental education including 
continuing education* In 1964 the Committee on Advanced Education 
of the American Association of Dental Schools published the findings 
of a survey of dental school programs, faculty, and participants 
(hereinafter referred to as the 1963 Survey) , which also provided 
considerable information regarding continuing dental education. 
A third national survey of note was that by the American Public 
Health Association (51) in 1964, This study sought to determine 
the general status of continuing education in dental public health, 
and more particularly, to identify the continuing education needs 
of dental personnel in public health services. 

In addition to these, over the past few years there have 
been a number of regional surveys defining the expressed learning 
needs of d^Kitlsts (63) (89) (1) (24) (65) (6), and a few pilot 
projects on extramural programs along with those using the newer 
educational media (27) (37) (32) (3). Generally speaking however, 
much of what has been written over the past decade have been 
opinions and viewpoints, particularly with reference to the main 
pre-occupatlon of the dental profession, "mandatory continuing 
education" (20) (25) (20) (30) (36), . . 
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CHAPTER" XII 
PARTICIPATION IN CONTINUING EDUCATION 

Although there is no accurate data available about participation in 
continuing dental education in general^ there is some data that suggests 
factors which may affect participation including location, field , patterns 
of practice, income, age, and the uses of information sources* Most 
writers estimate that in any given year less than 25 percent of the dentists 
in the United States participate in continuing education programs (6) (29) 
(43) (88) • Tvo national surveys provide estimates of 40 percent (63) and 
49 percent (84) respectively, but local surveys tended to be less optimistic. 
A survey of 34 percent of the dentists in Kentucky (24) revealed that 26 
percent had attended one continuing education course during 1967-1968, 
32 percent had attended two or three courses during this period, 25 percent 
had attended four or more courses, while 27 percent n^ported no course 
attendance. On the other hand, a review of attendance records at the 
University of Kentucky revealed that over a seven year period, the average 
annual attendance in programs offered at the university equalled the oft 
quoted national average of 12 percent (6) • 

In Minnesota, a 1963 survey (64) based on approximately two-thirds 
of the practising dentists in that state disclosed that roughly 43 percent 
had taken at least one course in the past two years, while approximately 
17 percent had not taken a course for ten or more years. Similarly, a 
recent survey conducted by the University of California found that of the 
102 respondents, 77 percent had taken courses within the past two years (1)* 
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These data suggest that participation In continuing dental 
education varies with the nature of tha sample population surveyed, 
the course sponsorship » and other related factors* 

Location ; 

It would appear that the geographical region In which the 
dentist practices is associated with participation in courses. 
It has been found that dentists in the United States living in 
the west And in the east are more likely to have taken courses 
than those in other regions (65) (84) • But this can be misleading 
since the highest percentage of dentists within reasonable access 
to dental schools are those located in the western and eastern 
states* Roughly one half of the nation's dentists are practising 
in locations relatively remote from dental schools. 

In general, most studies reveal that while dentists will 
travel long distances seeking desirable courses (41) (6), the 
majority prefer courses closer to home* The 1963 survey of dental 
school programs (65) found that 46J8 percent of the course partic- 
ipants had travelled no more than 100 miles. 

Field of Practice : 

Dentists in specialty practice have been found to take 
or to have taken more continuing education courses than those in 
general practice (89) (1). In the national study reported by 
O'Shea (65), 86 percent of the specialists reported having taken 
courses whereas only 60 percent of general practitioners had done 
so. Among the specialists » more orthodontists were found to have 
taken courses than those in other specialties. Tlhls study also 
revealed that dentists who engaged in teaching and/or research, 
were more likely to participate in continuing education than those 
who engaged only In practice. 
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Patterns of Practice ; 

Questionnaire responses from over AOOO dentists in the six New England 
States (89) revealed that dentists in partnership and/or located in a dental 
building 9 were more likely to have taken courses than those in solo practice 
or located in non-dental buildings. 

On the other hand, O'Shea (65) found that neither practice arrangements 
nor office location were related to course attendance; however, 72 percent of 
the dentists with two or more auxiliary aides had taken courses as compared to 
53 percent with no auxiliaries. In addition, 72 percent of the dentists wbo 
scored high on the use of preventive procedures had taken courses In contrast 
to only 54 percent scoring low on their use. A similar trend was also noted 
with respect to the variety of modern equipment in use, "The more such equip- 
ment the dentist had, the more likely he was to have taken courses and to 
have taken them recently." 

Income, Age ; 

Several studies reveal that dentists in the higher Income brackets 
are more likely to take courses (1) (89) (65). In the California study, 
66 percent of the respondents earning $11,000 to $15,000 had taken courses 
compared with 80 percent in the $16,000 to $30,000 income bracketed). Simi- 
larly, in New England 57 percent of the dentists whose income was in the 
$20,000 or more bracket reported course attendahde versus 39 percent of 
those whose net income was less (89) • 

A national survey by the American Dental Association (84) found that 
dentists in the 30 to 50 age range were found to enroll in courses of continu- 
ing education while beyond 50 there was a steady decline in participation* 
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Use of Infpraatlon Sources s 

Unlike physicians who tend to rank formal courses first or 
second in order of importance, dentists tend to rate reading, 
meetings, conventions, study clubs, and informal contacts with 
colleagues higher (90) (89) (63) (64) (23) (67)* An exception to 
this rank ordering was found in California (1) where respondents 
rated continuing education courses as the most important way of 
keeping up with new developments. While this survey was based on 
a sample of University of California alumni and may be -biased, 
this difference may be the result of the fact that the State of 
California has been very active in the field of continuing dental 
education (1) . 

O'Shea (63) found that a greater proportion of respondents 
who rated formal courses as the most important method of keeping 
current were also more likely to have taken one or more courses. 
Moreover, he found that dentists who used other means of keeping 
up were also more likely to have taken refresher courses. Attendance 
at local, state, and regional meetings showed a lesser relationship 
to course attendance than did participation in study groups and 
membership in general and specialty dental societies. 

While reading is heavily endorsed as a way of keeping 
up to date, the Minnesota survey (64) revealed that 63 percent of 
the responding dentists spent less than five hours a month reading 
dental journals. In contrast, attendance at study clubs and dis- 
cussion groups was fairly high, with approximately two-thirds 
reporting attendance at 40 or more meetings in six months. 

A recent survey by the American Dental Association (84) 
revealed that 36 percent of the dentists responding belonged to 
study clubs that met regularly. Of this number, dentists in the 
North West region reported the highest study club membership 
(44.3 percent) while dentists in the New England states reported 
ERXC lowest membership (28.7) percent. 
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Surveys of dentists In Colorado and Wyoming revealed that society 
meetings and study clubs were most often used as sources of contlhuing 
education by dentists up to age 55. Thereafter, journals became more Important • 
It was also found that young graduates tended to rate their own practices 
**a very important source of continuing education** (23) • 

Reasons for Attending or Not : 

Data gleaned from surveys suggests that from 70 to 90 percent of the 
dentists are willing to participate in programs of continuing education (89) 
(23)(24), In California (1), 80 percent of the respondents stated that interest 
in the subject was the major factor motivating attendance, 73 percent listed 
the improvement of office practice and procedures, 23 percent indicated a 
professional obligation, 5 percent were motivated by membership in the Academy 
of General Dentistry, and 4 percent attended as a result of a suggestion from 
a colleague. In Kentucky (24), 86 percent of the respondents listed subject 
matter covered as the most important stimulus to course attendance, 39 percent 
were drawn by the reputation of the clinician instructor, 34 percent by course 
location, 17 percent by the time of yearj^ and 13 percent were motivated by the 
low cost of the course. 

On the other hand the most frequently cited deterrents to course 

attendance (not necessarily in order) are: lack of time, distance (89) (24) ; 

■ ■ . I 

(1), costs (24), uninteresting topics (1), and no courses available (23) • 
Sponsors : 

Dental schools sponsored the majority of courses attended by dental 
practitioners with dental societies ranking second (63) (24) (64). Commercial 
organizations t hospitals^ clinics t and other miscellaneous groups accounted 
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for by a small percentage of the courses taken. On the other hand, 
dentists give first preference to courses sponsored by dental societies 
with dental schools rating second (23) (89) , and a few Indicate that 
they prefer small group sponsors such as study clubs (23) • 

Scheduling of Programs ; 

Dentists are more or less unanimous in their preference for 
courses scheduled on Wednesday (11) (47) (23) or week-ends (73) (23), 
The majority also express a preference for short courses lasting three 
days or less (11) (47) (23), A substantial number indicate that they 
would be willing to attend courses scheduled on an intermittent basis 
weekly or monthly over a period of time (24) (23) (47). 

The choice of location for courses varies widely. The most 
frequently cited locations include: university dental schools; local 
hotels; local hospitals , oi'* clinics; and community colleges (89) (23). 
In New England, disntlsts in stages with a dental school (Massachusetts 
and Connecticut), cited the school aa the most frequently chosen, 
location. 

Tuition Fees ; 

The majority of dentists do not question tuition fees (47) (24). 
Cost is a deterrent more in temnsof the loss of income and travel 
expenses than the fee In itself. One study found that 63 percent of 
the respondents felt that the cost of cour&es was about right, 25 percent 
thought they were too expensive, and 10 percent Indicated that continuing, 
education courses would be attractive even if the costs were slightly 
higher (24). 

Felt Learning Needs : 

Although varying somewhat In rank order, the course topics most frequently 
chosen by dentists in New England (89) reflect the subjects ranked highest 



Inmost other surveys (73) (11) (23) (1) (63) (64). These include: crown 
• and bridge, complete dentures, periodontics, operative dentistry, and practice 
administration. In addition, other topics cited frequently include: diagnosis 
and treatment of emergencies (73) (23). and the use of dental auxiliaries (73). 
In New England (89), dental public health, hospital dentistry, and the cate 
of special problems were the least preferred topics. 

The Kentucky study (24) solicited dentists' opinions with respect to 
course offerings and content for auxiliary personnel. This revealed that 64 
percent would like courses offered for dental assistants, and 35 percent indi- 
cated that they would be interested in participating in courses with their 
assistants. The most important courses for dental assistants were felt to be: 
office management, chairslde assisting, dental health education, and dental radio- 
-graphic technicians, in that order. Cour*,es which were felt to be most 
important for dental hygienists were: dental health education and the use of 
mechanical scaling devices. Preventive dentistry and fluorides in dentistry 
were given top priority for hygienists intone study (24). 

Most of the program directors who responded in the Dental Public Health 
Survey (51) in 1964 indicated that the greatest training needs were in the 
areas of public health administration and health education. Local, program 
directors also rated training in clinical procedures high in their list of 
priorities. 
Instruction ; 

Dentists express a general preference for teaching techniques which 
facilitate personal contacts. In New England (89), the techniques most pre- 
ferred were demonstration.. 63 percent; participation. .58 percent; lectures.. 51 
percent; and discussion. .46 percent. Least preferred were non-personalized 
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methods such as television. .18 percent, movies. .13 percent; corre- 
spondence. .4 percent, and teaching machines.. 3 percent. With the 
exception of television which ranked relatively high in Interest 
value In several studies (23) (24), this list more or less reflects 
dentists^ preferences with respect to instructional techniques. 

The lack of familiarity with availability of educational 
media may be a significant factor in the low level of choice for 
the media. In the WICHE (Western Interstate Commission on Higher 
Education) survey (90), it was found that older dentists tended 
either to be unaware of the different sources of information or 
disinterested in those not available. Younger dentists on the 
other hand^ were more aware of their need for a variety of different 
opportunities not available to them. The instructional processes 
not available but desired were: demonstration clinics. .52.9 per- 
cent; television. ^51. 7 percent; supeinrised clinical practice. .50.8 
percent; group discussion. .47.2 percent; radio.. 42. 8 percent; and 
lectures or symposia sponsored by local hospitals . .42.6 percent. 

Instructors ; 

In the Kentucky study (24) , respondents were asked to 
evaluate university faculty members as Instructors for continuing 
education courses. Forty-five percent of the respondents thought 
that university faculty did a better job of organl25ing and presenting 
material than did dental practitioners, but 55 percent thought that 
frequently faculty members were too academic in their approach, con-* 
centrating on research rather than practice matters • Some 16 percent 
thought that faculty were not as appealing as nationally recognized 
specialists. 
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CHAPTER XIII 
PROGRAM ADMINISTRATION AUD ORGANIZATION 

The nature and structure of dentistry as a profession coupled with the 
geographical distribution of its members has created problems that are barriers 
to the systematic development of continuing education in dentistry. Although 
these barriers are by no means insurmountable, they do account, in part, for 
the slow growth of continuing education in the profession, 

ADMINISTRATION 

Continuing education programs in dentistry are sponsored by dental 
schools p medical schools, general and specialty professional societies, hospitals, 
graduate dental institutes, affiliate member institutions of the American 
Association of Dental Schools, and by private groups of dentists in a locality. 
Of these, dental schools are the principal sponsors of formal courses. In 
1970 (13) (14) (15) , dental schools in the United States and Canada offered 
1,095 courses, as compared with 340 courses recorded as offered by all other 
sponsoring agencies. Of dental school offerings, in 1970 eighty-eight courses 
were designed specifically for dental auxiliaries which represents a substantial 
Increase from 1965, when only 19 courses were offered to auxiliary personnel 
(16) (17) (18). 

Insofar as it can be determined from course liB tings aojne 60 to 70 
percent of the courses limit enrollment to 50 or less and have stipulated the 
use of participative teaching techniques in ad^3±tion to demonstration and 
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lectures (13) (14) (15) (16) (17). In practice, however, it is reported 
that a high percentage of the courses use chiefly non-participative 
instructional techniques (10) (5) (45). In 1970, over 80 percent of 
the courses offered were of less than five days ' duration and were 
designed for general practitioners. Tuition fees ranged from none to 
$700 for one twelve day course on Oral Rehabilitation, The most freq- 
uently offered courses were: Pros thodontics. .252; Orthodontice. . .136; 
and Periodontics. .98, with only 36 courses offered on Preventative 
Dentistry. 

A survey (78) of over 200 continuing education programs in the 
State of Massachusetts in 1968 disclosed comparable findings. The 
majority of programs being offered were short term and heavily weighted 
towards clinical subjects. This study also found that 85 percent of all 
dental society meetings with an educational content were in the Greater 
Boston metropolitan area. 

A 1963 survey (76) of 36 dental school programs revealed that 
the majority of courses being offered were located in the universities. 
These few schools reporting facilities other than campus locations listed 
local hotels, motels, and resort areas. A survey (51) of 46 dental schools 
in the United States and Canada disclosed that in 1965 only 8 schools 
offered 16 courses for dental public health personnel. Tuition for these 
ranged from none to $50, with little relationship between the amount of 
the fee and the length of the course. All courses were available to 
dentists and some to dental hygienists. 

Administrative Arrangements; 

The 1963 Survey (76) revealed that in many dental schools continuing ed- 
ucation programs were organized on a rather informal basis. In 12 schools the 
responsibility for- planning and implementation was delegated to the chairman 
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of the postgraduate division, while in 5 schools programs were directed by the 
dean of the dental school, with course implementation being delegated to an 
advisory committee or director of continuing education. In another 5 schools 
the assistant dean was also the director of continuing education. The remain- 
ing schools reported a part-time chairman who had additional teaching responsi- 
bilities in the undergraduate division of the school. In most cases, salaries 
for those in charge of the continuing education program came from the regular 
school budget, but in no case was a supplementary salary given to full or 
part time faculty participating in programs, although guest lecturers from 
elsewhere were paid an honoraria in most instances. 

Although detailed information concerning the administrative arrangements 
in other sponsoring agencies were not available, in the 1960 Survey of 
Dentistry (A6) , 25 of the 38 state societies which responded felt that they 
did not have appropriate committees for co-ordinating or implementing programs 
in continuing education at the state, district, or local level. More recently 
there is some indication that dental societies are becoming increasingly 
involved in continuing education in conjunction with dental schools, departments 
of public health, and other sponsoring agencies (76). The general impreysion 
is that in most cases continuing dental education is individually sponsored 
(53) (34). 

Instructors and Facilities ; 

Lack of . suitable facilities and qualified instructors have been identi- 
fied as two of the major problems in continuing dental education (46) (62) , and 
the situation does not appear to be Improving over time. Although there have 
been many articles advocating the use of hospitals, mobile classrooms, 
television, andother facilities which may make continuing education more 
readily accessible to practising dientists , their use has been limited (77) (52) . 
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Both Harris (40) and Romano (77) revealed that with the exception 
of dental scolety meetings » television has scarcely been used for 
continuing dental education. Similarly, except for several recent 
pilot projects In the use of programmed Instruction and teaching 
machines, self-instructional and other educational devices have yet 
to be explored. 

There are many reports of attempts to upgrade instructor 
qualifications through in-service training programs; however, it 
appears that the majority of these are inadequate (43) (92) (79) • 
Shepro (80) investigated teacher education in dentistry and found 
that most graduate and postgraduate courses on teaching placed a 
major emphasis on dentistry rather than on the science of learning 
and Instruction. He concluded: "It is necessary therefore, to 
educate more teacher teachers before adequate In-service courses can 
be established" (80). 

Finances ; 

Most dental school programs are relatively self-supporting 
except for overhead expenses. In the 1963 Suirvey (76) only 4 of the 
reporting schools indicated that they were operating at a deficit, 
while 26 schools reported that they had surpluses from time to time. 
O^Shea and Black (63) believe that this heavy reliance on tuition to 
* cover costs has contributed to the tendency in continuing dental 
education to "provide courses solely to accommodate what the dentist 
may want rather that what he may need. " 

This market economy approach to continuing education also 
accounts in some measure for the paucity of innovative programs in 
continuing dental education. In 1956, Levy (52) warned: 

We are awarei of the fact that education rarely pays for Itself; 
the author personally feels that even on a postgraduate level 
It should riot., If ^ the benefits to be derived from extension 
education are to be continued, however, the dental profession 
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must realize that no one institution can afford to bear all the 
cost, and that the profession must take a greater responsibility 
for finding -vjays and means of sharing the cost. 

In this respect, while the language of Public Law 89-239 in the United 
States, "permits and even urges indirectly that dentistry be included in the 
policy structure of the regional medical programs .since the inception of 
the regional medical programs there has been little formal inclusion of 
dentists in the programs and little ptoject development by dental agencies" 
(33). Indeed, with the exception of several very recent pilot projects, the 
findings of this review suggest that neither governments nor voluntary agencies 
have played a significant role in facilitating the development of continuing 
dental education. ^ 

Publicity and Promotion : 

Programs are publicized primarily through course listings published 
in the January, May, and September editions of the Journal of the American 
Dental Association . Monthly announcements providing more detailed information 
on coming educational events are also published in the "News on Dentistry" 
section of this journal. In addition, specialty journals, brochures, special 
pamphlets, word of mouth, and personal communications , are other commonly used 
methods of publicizing course offerings (83) (10) • 

To encourage dentists to attend courses, sponsors of programs also 
report the use of various incentive plans, including credits toward certificates 
or fee discounts varying proportionately with the nuiiiber of course hours of 
instruction attended (76) (86) (58) . The University of Pittsburgh School of 
Dentistry has formed a Post Graduate Scholars Association. On completion of 
100 hours of instruction a dentist is considered a "member" and is entitled 
to a 20 percent reduction in tuition ; after 300 hours he becomes a "scholar" , 
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entitled to a 50 percent reduction in fees. These courses may also 
.be used for credit in the Academy of General Dentistry, which requires 
regular participation in continuing education as a condition of 
membership. 

Another interesting plan is offered by the St. Louis 
University School of Dentistry. To encourage the young dentist to 
continue his education, the dental school gives each new graduate 
five Certificates for Continuing Dental Education. The flret 
entitles the dentist to a free course and the other four provide 
for half tuition. These certificates are valid for the first two 
calendar years after graduation (58). Some dental acho^ils offer courses 
under a special dividend plan designed specifically for members of the 
Academy of General Dentistry (37). 

PROGRAM PLANNING 

Most of ,the programs for continuing dental education follow the 
traditional patterns encountered in all adult education. Program plan- 
ning appears to rely heavily on participant opinionnaires . There are 
many descriptions of questionnaires used to ask participants what they 
liked or did not like about a course, or what they would like Included 
in future courses. Other than one article by Barker (5) stressing the 
need for more clearly defined objectives, this search of the literature 
yielded no reports of attempts to identify real learning needs system- 
atically, nor were any studies found which attempted to relate partic- 
ipation to actual changes or Improvement in dental practice. 

Darby and Weiss (22) refer to present course offerings as "an 
unorganized and unsystematic educational smorgasbord from which the 
individual dentist must choose what he thinks will be most useful to 
him". They note that relevant programs for continuing education must 
be directed towards a lifetime of learning consistent with three basic 
priiicli^les:;\ ; -.^:;,.<^. -^ ; 



Rir 



267 



1. Comprehensive well organized and sequential programs. 

2. Equal educational opportunities for all dentists. • .opportunities 
that are accessible » convenient, and continuously available. 

3. Learning experiences that are compatible with sound learning 
theory and principles. 

To fulfill these requirements, they call for the establishment of a 
national' plan, much like that proposed tn the Dryer Report (28) for the field 
of medicine. To achieve this long r. goal they stress the need for 
coordinated action by all official and voluntary bodies concerned with 
continuing dental education. No pattern of co-ordination has yet been estab- 
lished that would be applicable everywhere, nor does It seem likely that such 
overall programri?.lng will be possible In the near future. Indeed, as noted by 
Furstman (34) , "it has been Impossible to co-ordinate all programs In any 
given state." 

One step In this direction was reported recently by the Dental Society 
of the State of New York (9) which announced the establishment of a Bureau 
of Post Graduate Information which will compile and disseminate data on: 
1) officially recognized teaching facilities and programs; and 2) current 
qualifications and postgraduate education of licensed deatists in the State 
of New York^ This information should assist sponsors in eliminating duplication 
and it should ultimately facilitate in some measure the designing- of programs 
for different levels of instruction. 

From the few program descriptions found in the literature, the following 
examples illustrate the varied approaches which have been tried <or are 
currently in use in continuing dental education. 

Study Clubs : 

'.Study clubs are a method of adult education unique to the field of 
dentistry* They began spontaneously as a systematic way for a small group of 
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dentists to provide for their own continuing education. Two 
characteristics of study clubs make them particular!;;' inactive: 

1) the members are involved in planning their own education, and 

2) as small informal primary groups they provide for member inter- 
action and facilitate the use of instructional techniques with high 
learner participation (87). Many study clubs provide their own 
programs and instruction dr&wn from the membership of the group 
while in other cases they seek expert instruction from elsewhere. 

The organizing concept of the study club Is not new in 
adult education as comparable groups have existed for centuries for 
different purposes. Benjamin Franklin originated such a group in 
Philadelphia which became known as The Junto . In every case, then 
as r-owy the study group is a significant method for providing a 
functional opportune ?:y for continuing education that meets the real 
needs of its participants. 

In the Guide published by the American College of Dentists 
in 1958 (12), the number and location of many study clubs was reported, 
including thirty that met regularly in Seattle, Washington. Other 
regions reporting numerous study clubs were Southern California, Oregon, 
and the mid-west. In recent years, dental schools and societies are 
sponsoring and encouraging the formation of study clubs (7). The 
University of Oregon plans and operates programs for study clubs, 
including the selection of instrue^ors, course descriptions, and 
fees as with its regular short courses. The members of a club define 
their own goals and plan definite programs for the year with univei^- 
sity personnel. During recdnt years, twenty-two such clubs met at 
the university and two in a Vererans* Hospital (87). 

At tilie University of Illinoi^^, Massler (57) reports: 

...study groups of 8 to 15 practitioners register at the start of 
each academic year and each group determines the, course of study it 
desires to pursue/ "The "groups meet either bnce a" month for a full 
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academic year or once a week for a full academic quarter. Outstanding 
men are recruited to neet with the groops. 

Pavone (68) describes the University of California study club program 

as : 

•*.one of the most exciting developments In continuing education for 
the general practitioner .These school-operated groups participate 
In discussions 9 seminars, clinical investigation » review of literature 
and clinical evaluation of materials and procedures. They offer one 
of the greatest potentlalc for short-term advanced training that 
has been conceived. 

Regional Programs ; 

The University of Oregon School of Dentistry has initiated a regional 
program which brings instruction to dentists throughout the state. Called 
Friday Special , classes are held one Friday afternoon of each month at six 
different regional centers. One dentist" in each area serves as co-ordinatbr 
and confirms attendance as well as participating in organizing the program 
in other ways. Courses have been presented as seminars, but future plans 
. include a clinical approach (60) . 

The University of Pittsburgh Dental School is conducting a similar 
but more extensive program in 15 ^'>gional centers distributed throughout the 
state and in surrounding states* College classrooms, private dental offices, 
hotel rooms and hospitals serve as teaching facilities • Teaching techniques 
include* closed circuit television, demonstrations » and lectures* Th*3. number 
of dentists attending any given program, is reported to vary from 8 to 35., 
Local representatives are invited to the university campus once a year to 
review the past year's program and to assiet in planning for the coming year 
(38). 

Since 1964, the dental staff of a rural hospital in Poughk^^epsie, Nei^ 
Yorky has been affiliated with a metropolitan teaching hoBpital. During a 
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ten day educational program participants from the rural hospital 
spend a period of time obseirvlng and participating in selected 
specialty areas at the metropolitan hospital. Reciprocally, the 
staff of the urban hospital visit the rural hospital to participate 
in a one day and one evening symposium in the five county area 
served by the hospital. Subjectively, "it is felt that this 
affiliation is contributing to the individual's continuing pro- 
fessional education and is stimulating research motivation in the 
participant dentists who return to St. Francis Hospital to share 
their newly acquired skills and enthusiasm with non-participL>:ting 
dentists" (32). 

Hospital Programs ; 

As hospital dentistry Increases in importance, a number of 
sponsors are offering special hospital orientation programs for 
practising dentists. In 1969, the Pennsylvania Dental Association 
initiated a series of hospital training courses which were financed 
by the U.S. Public Health Service. Six courses of 10 to 12 trainees 
each were conducted in fivtl Pennsylvania hospitals. Each course 
provided a minimum of 18 hours of instruction which included 
lectures and demonstrations on the use of drugs, laboratory tests, 
operating room procedures, and similar matters. Evaluaticu forms 
filled out by the participants indicated that the courses were 
helpful, and many ^f elt that they should be longer (48). 

The Glenwood Hills Hospital and the Easter Seal Socidty in 
Minnesota are also co-sponsoring a similar type of hospital 
orientation .program. An evaluation of this two day program dis- 
closed that dentists who had participated in the seminars were 
providing more hospital treatment for those ^ Clients requiring 
It (35), 
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Professional Meetings ; 

The American Dental Association's Annual Session Is probably the 
most comprehensive continuing education ' " i' offered In dentistry. Extending 
over a number of days. Its purpose Is to kc v practising dentists abreast of 
the latest developments In dentistry. The form^it includes panels, forums, 
symposia, individual essays, clinical lectures, table clinics, plUs a variety 
of scientific exhibits. Attendance at these is reported to be 10,000 or more 
(75). 

Television Programs ? 

With financial support from the W.K. Kellogg Foundation, the University 
of Illinois College of Dentistry is credited with the first use of closed 
circuit interstate television. This program, consisting of 4 weekly c.:.: isions 
was accompanied by additional eupplementary materials. As reported by Levy 
(52) , this program was successful in every way except for the cost which was 
considered prohibitive. 

According to Harris (AO) ,^ the University of Pittsburgh School of 
Dentistry was the first to experiment with open circuit television in continuing 
dental education in 1980. This program consisted of 4 one hour dental clinics 
recorded on videotape and telecast on 4 consecutive Sunday evenings during off 
air time. Although the effectiveness of this program was considered favourable, 
George reports (38)) that it was discontinued because of lack of funds. 

In 1967 Ballantyne (3) reported a series of three weekly programs 
sponsored by the Oregon Dental Association, and 'V^lecast over open circuit 
television in Portlenc ^rp<>on. This progr^v?i v^is designed expressly for 
dentists but was open to public vie^jclngt. : . of 45 dentists by 

questionnaire Indicated that 44 pe^^cent thought the program was good, 31 percent 
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excellent^ and the remainder fair to poor. In concluding his report. 
Ballantyne coimnents: 

Much of the success of television programs depends on the 
ability of those presenting the material to project them- 
selves and command the attention and interest of the viewers. 
Drawing the clinicians from lay members of the dental 
association presents difficulties. The use of television 
requires that all concernAd learn special skills and techniques 
to be effective. 

Since 1968 Tufts University School of Dental Medicine has been 
conducting an open circuit television series called Boston Dental Reports, 
fashioned after the Boston Medical Reports. The programs are produced 
through the facilities of Boston's educatioiial television station and 
distributed to educational television stations in New England by the 
Eastern Educational Network. Aided by support from the U.S. Public Health 
Services Division of Dental Health and The American Cancer Society, 
the pilot series consisted of three 30 minute colour programs which were 
made available later to dental groups and study clubs (85) . According 
to Dale (21), program effectiveness will be assessed in a -?Dber of ways: 
1) audience participation; 2) knowledge gain; 3) utilization of new 
materials, techniques, and equipment; and 4) changes in concepts of 
dental practice such as work simplification, preventive dental pro- 
cedures In dental practice, patient education, or changes in refeir.ing 
patients to specialists. Also included in future plans are "the use 
of satellite dental teaching teams with accessible mobile or fixed de.xtal 
units for demonstrations or participation using modern teaching aids 
for fural dentists who are too busy or reluctant to travel distances 
for assembled education". 

Drir.nan and Greene (27) report on consumer evaluation 
of an open circuit television series. Consisting of ten one-half 
hour programs, the series was broadcast from four upstate educational 
television stations associated with the New York Network and one 
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'ifi New York City. Programs were announced in local dental Society 
journals, the press, atld in television program guides. Of the 
425 dentists responding to a questionnaire, only 2Q5 oir 48 percent of the 
respondents indicated that they had known about the programs. About 25 percent 
of these learned of the series through the newspaper, 25 percent through their 
dental society bulletin, and the rest by television program guides or by word 
of mouth from colleagues. Only 117 (58 percent) of those who knew about the 
series could receive the transmissions on their television receivers. Forty- 
five dentists indicated they had watched the first program, 42 watched the 
second, and 39 watched the third. .Only four had watched all ten prograii:i and 
18 had seen only one. The main reason given by those not watching was the 
inconvenient broadcast ':ime. 

In discussing ways to improve motivation to participate in televized 
programs, the authors recommend: 1) that upon showing evidence of viewing 
the programs dentists be granted credits which could be applied toward continuing 
education requirements; 2) that dental societies or dental schools contemplating 
producing television programs seek the services of a professional consultant, 
a- television director producer; and 3) that special efforts be made to publicize 
and acquaint potential viewers with details concerning the programs. 

DiFaggio (26) reports that the launching of the largest, state educational 
television network in Kentucky has resulted in a multidisciplinary approach to 
educational television for the health professions and the allied heaWi groups. 
The co-sponsored series of televized programs called PANMED began in October, 
1969. Although initially planned as a series of 15 programs, in which all the 
disciplines would be represented, the pressure of time resulted In the decision 
to use existing apes and motion pictures for initial programs. In hopes that 
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the health professionals in each discipline would view the entire 
series 9 schedules of programs were sent to all health professionals 
in the utate. 

A questlonnaird wai? used to evaluate the first four shows. 
Of the 303 dentists responding, 130 (42,99 percent) reported viewing 
part one and 105 (34.6 percent) part two. DlBaggio concludes: 

The results of the survey seem to support an earlier study of 
continuing education in Kentucky in which it was reported that 
12 percent of the state's dentists attend continuing education 
courses. Apparently, this percentage cannot be appreciably 
increased by bringing the programs into the home (13 percent 
watched the television programs devoted to dentistry). 

Correspondence ; Programmed Ins tructlon ; 

The United States Naval Dental Corps :ias been offering con- 
tinuing education through correspondence study since 1957. This 
consists of general courses on dental specialties and shorter topical 
courses which are structured in a format similar to that used in 
programmed learning. The target audience includes reserve officers 
and those on active duty. During the first five year trial period 
Heck and Lackey (44) estimated an enrollment of 7,000 with an 89 
percent completion rate. 

The Division /of Dental Health of the United States Public 
HeAith Service has been experimenting with pilot projects utilizing 
programmed instruction on individual and group teaching machines. At 
the Division's Dental Health Ceiiter in San Franclsdo a team of spec- 
ialists prepare programmed materials for iKaachine presentation. To 
date, thousands of dentists have taken irhese experimental courses 
which are not available on a wide variety of subjects (61). 

For the past six years the Division of Per iodonto logy of the 
University of California School of Dimtlstry has been using programmed 
instruction in its continuing education projects. Under a grant from 
the United States Public Health Service j> it is developing self- 
Instructional materials on Perlodortology specif Ically designed for 
^'-3neral practitioners (69)* 
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Information Retrieval ; 

The Dental Training Center located in the Veteran's Administration 
Hospital in Washington, D.C., serves as a major resource center for the 
production and distribution of audiovisual materials. Using the facilities 
of the hospital, the center has been developing Smm. single concept films in 
such specialized areas as Periodoiitology , oral surgery, prosthodontics, radio- 
logy, oral diagnosis, and patient fe.ducatlon. By the end of 1968, it was 
estimated that over 75 cartridge films would be available to supprrt the 
educational programs for veterans' administration dentists. It was also 
expcctsd that the films would be made available for purchase by interested 
individuals and groups (81) . 

The Audio-Visual Library of the American Association of Orthodontists 
is currently offering over ninety different slide-tapes and 16nua. films on 
different dtmtal subjects on a loan-rental basis. In 1967, more than 2,000 
individual programs were distributed to orthodontist departments at dental 
schools all over the world. Presently the Audio-Visual Committee, is 
"investigating the use of photograph book-tape programs for individual use, 
use of cassette tapes, and other possible ways of expanding the value and 
use of the Audio-Visual Library" (50). 

The American Dental Association Library, or Bureau of LJ^rary and 
Indexing Service (BLIS) located in Chicago, provides a two week loan service 
to association members anywhere in the country. In 1968, 10,268 books, journals i 
micro-films, and package libraries were reported in circulation. Another 
Important pert of the Bureau's function is the indexing of dental journals, and 
more particularly, its production of the Index to Dental Literature, in 
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co-operation with the National Library of Medicine (71) . 

CURRENT AND RECURRING ISSU E S AND TRENDS 

■p- ■ n ^ ^ ^^1 — . ^ 1 m,^ n I 

T^^^bst significant developnient in continuing dental ed- 
ucacxo.^ - ^er the past decade has teen the increased demand f6r r change 
in state dental lai^s which would make participation in continuir^i; 
education a requirement for practice. At least four states, including 
New York, Kentucky, Oregon and Pennsylvania, have made participation 
in continuing education mandatory. California, Kinnesota, Missouri, 
and New Mexico are proposing changes in the law that would also make 
continuing education mandatory (25)4 

The issue remains highly controversial. Since the precedent 
set by the New York State Health Department's Title XIX of the Social 
Security Act, which "pv '^-scribes the standards of continuing education 
which dentists must meet in order to participate in the Medacaid 
program** (2), movement in this direction seems inevitable. Reasons for 
and against mandatory continuing education were summarized at a 
recent conference sponsored by the Philadelphia County Dental Society 
(54). In Brief, arguments in favour were as follows; 

Tax supported health care programs are with increasing 
frequency requiring evidence of the competency of the 
professionals who will render the service. Hence if 
the profession does not set the standard and provide the 
mechanisms, for ensuring -^compdtence, government agencies 
will. 

The general impression is that many dentists arc not keeping 
their knowledge up to date . . 

The trend is in the direction of more rigid requirements in 
all segments of. the profession, and this trend will probably 
be carried into the field of continuing education. 

The quality of dental servides would improve and the image 
of dentistry will be enhanced in the eyes of the public. 

Conversely » arguments against mandatory continuing education 
include: 
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Continuing education is the responsibility of the individual dentist 
and the profession as a whole. More carefully planned quality education 
would provide the incentive for individual dentists to participate. 

Compulsion of any kind that would tend to coerce a group into forced 
education processes might result in an attitude of rebellion that 
would not be conducive to meaningful learning. Attendance of 
continuing education does not mean necessarily that the knowledge 
gained will be applied in practice. 

Self motivaLed learning is more likely to lead to a thorough and con- 
scientious performance of service. 

There is actually no positive proof with regards to how much continuing 
education dentists engage in. This is particularly true with regards 
to how much a dentist reads on his own, how many scientific meetings 
he attends, or how often he improves his knowledge through consultation 
with colleagues. 

In its 1968 Annual Report (83) the Council on Dental Education of the 
American Dental Association issued the - Dllowing statement: 

The Council feels strongly that the iinal determination of the require- 
ments and procedures to be utilized by agencies of the dental profession, 
to promote and assure continued competence must be the responsibility 
of state societies and dental examining boards. It should be the 
prerogative of the boardr and constituent societies to detfermine the 
amount of continuing eduf on that should be expected of the practi- 
tioners in their states. should be their prerogative to decide 
whether continuing education should be required for licensure renewal... 

In this respect, a recent survey of stata boards of dental examiners 

disclosed that more than two-thirds of the 43 - --sponding boards felt that 

contlnuiag education should be voluntary and expressed reluctance to pass 

legislation to make it compulsory. Most boards indicated that continuing 

education for dentists was not too successful. As one respondent put it: 

I feel that AADE should encourage continuing education, but there is 
a problem of good programs and facilities. If the programs are 
really good and offer what practitioners need you will not have to 
pass laws and require dentists to attend. Too many dental meetings 
offer the same old lectures and speeches that have been given over 
and over for years (38) . 

DiBaggio (25) suggests that a "realistic solution would be ::o teach 
the dentist to self -learn," but adds usefully, "measuremeat of how well he 
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does 9 presents certain problems". 

In continuing dental education, needs and problems are by 
far more evident than progressive trends. Nevertheless, according 
to Weclew (88) s 

The ideas emerging about continuing education for the general 
practitioner seem to be taking the following pattern: 

Every effort should be made and every means explored to 
motivate the practitioner to participate in continuing 
education. 

Relicensure should be regulated by the profession itself. 

A program and curriculum that would raise the level of all of 
dentistry should be developed: 

Refresher courses should be planned to interest all 
dental graduates and should include a review of basic 
dental concdpts and a resume of the newel' concepts. 

More sophisticated courses should be offered to those 
who have had the preliminary c&ursss. 

A program of continuing education of yearly courses to 
be attended throughout the dentist's entire pro- 
fessional career should be planned. 

A postgraduate course, that will lead to a certificate 
and diplomate in general dentistry should be developed, 
with the length of time to be extended so that the 
dentist can practice while attending school. 



2. 
3. 

A. 
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CHAPTER XIV 
SUMMARY 

Continuing education in dentistry has not developed as extensively 
nor over as long a period of time as has occurred in other health professions. 
This is due, ±n part, to the individualistic nature of the profession and to 
its relar:lve isolation from the inainstream of the general health services. 

Surveys Indicate that while there is a shortage of dentists in North 
America, there is also a problem of maldistribution and ineffective utilization 
of available dental manpower. Furthermore, the traditional framework within 
which dental practice is organized serves as a barrier to innovation and change. 
Accordingly, thet proposal is being advanced increasingly that continuing 
education must stress: 1) new practice methods, such as group practice or the 
use of auxiliary personnel; 2) greater social responsii>ility including care 
of special problems and preventive dentistry; and 3) greater integration of 
the biological sciences* 

On the other hand, practising der^^tists are requesting short two to three 
day courses on "bread and butter topics ^ifhlch will be of immediate benefit to 
them" (38). There is some evidence that 3ome dental practitioners feel that 
university faculty are not skilled in translating research into terms meaningful 
to clinical practice. 

PARTI g lFATION 

The participation patterns of dentists are not materially different 
fri?a) those In the other health sciences. The two major deterrents to partlci- 
f.Bt±on tCx continuing education programs ar6 a lack of time and distance. While 
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a lack af time Is questioned by many (10) (31) (49), the geographical 
dispersion of dentists, both with respect to their practice and with 
reference to the location of dental schools, suggests a need for 
decentralized programs* In addition, since many dentists In^licate a 
lack of familiarity with th,e -newer educational media which could help 
to make education more convenient, there should be greater use of 
these in continuing dental education. 

ADMINISTRATION ASP ORGANIZATION • 

In terms of faculty, finances, and facilities, continuing 
education is given a secondary place in dentistry. There Is also 
considerable evidence to suggest that many sponsors are providing 
courses solely to accommodate what the dentist may want, rather than 
what he may need. This appears to be related to two problems: 
1) the heavy dependence on tuition fees to finance programs; and 2) 
the difficulties Inherent In precisely defining educational needs. 

Other major inadequacies identified in this review include: 
1) the almost complete absence of program evaluation; 2) the lack of 
Imaginative, innovative program models; and 3) the pressing need for 
decentralized programs which would make continuing education more 
readily accessible to practising dentists. Moreover, if an Impact 
Is to be made on the preventive and social aspects of dentistry, 
ongoing integrated programs are required. This calls for much 
greater co-operation among the various agencies presently offering 
programs.. 

Despite these and many other shortcomings, it would seem 
that the increasing trend toward making continuing education a condittbon 
for practice, has had some positive effects on the development of the 
field. Foremost it has forced the professional associations, dental 
colleges, and other agencies responsible for stemming the tide of pro- 
fessional obsolescence to search for nmr methods and approaches to the 
process of continuing education* 
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CH^TER XV 
THE PROFESSION AND CONTINUING EDUCATION 

With the transfer of drug production from the local pharmacy to a 
highly Bpeelali^ed pharmaceutical industryp the traditional combining and 
compounding akills of tha pharmaclet are fast becoming obeolatai, At the eama 
tima^ in tha wake of the so^callad "drug revolution ^"ph^rm^clBta have a 
major rola to play In enaurlng "adequate controls in the handling and dispen- 
sing of today's potent drugs" (30). Accordlnglyj the profession of pharmacy 
is presently seeking to define and interpret this mainstream professional 
ftinction w:lthiti the context of th% changing hBmlth care @yitem« 

COtgOSITlON AND DISTRIBUTION 

Ross (33) surveyed the field cf pharmacy in 1964 and found that the 
dietrlbutlon of pharaaclsts In Canada followad a pattern eomawhat similar to 
that raported for dentlste and phyeicians. In short p British Columbia, 
Ontario, and Hanltoba, reported the most optimum phannaciet/populatlQn ratios , 
while Newfoundland and the Yukon Territories reported the least favourable 
situation. In all regions the large urban centers were found to attract the 
greatest numbers and the younger pharmacists, A great majority of pharmacists 
in this country were engaged In retail pharaacy in 1962 « 

Although more recent figures were not available for Canada as a whole, 
pharmacist manpower statistics in the United States (11) and the 1968 Survey 
of Pharmacy In Ontario (22) suggest that the tmnufacturlng and retail branches 
of pharmaey are still absorbing the greatest nimber of pharmacists. In the 
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meantime, there Is evidence to suggeBt that hospital pharmacy is on thi 
ascendancy and predictions are that as medical care becomes more hospll 
based it will beccme necessary to increase the numher of hospital phan 
and specialiEed training programs related to Institutional pharmacy pi 
(10). 

The proportion of women in pharmacy is reported to be increasin; 
(33). The Ontario study (30) revealed that in the 1967 graduating cla 
Faculty of Pharmacy at the University of Toronto, 40.1 percent of grad 
were women as compared to an average of 5,5 percent In the years 1926 
Hospital employment appears to attract a far greater number of female 
cists that it does males (33). If these trends continue, they will ha 
important influence on the future nature of th© profession. It can be 
that as the proportion of female graduates Increases, a larger number 
pharmacists will leave the profession at least temporarily after «lat 
few years of practice, and that an equally large number of pharmacisti 
in hospital pharmacy will be part time workers. From the point of vii 
continuing education, this will mean that the profession will have to 
m its long range plans an appreciable increase in the number of ongoJ 
flexibly scheduled refresher courses. 

As might be expected, faculties of pharmacy and research divlsi 
manufacturing establishments attract those few pharmacists with advani 
degrees, while those with the minimum basic educational requirement ai 
primarily in hospitals and retail work (33). Brodie (10) notes, "thi 
future of pharmacy might well have been cast in a different mold had ] 
chosen the nodel of medicine eatabllshlng the minimum educational reqi 
for practtlce as a profeBalonal dtictor'sdesree." He believes that th 
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development of a sound profeisionally orlenttd program o£ pharmaceutical 
education at the tine medicine •stabllshed Its baalc educational program 
would have kept the practlca of pharmacy fre# of the comaerclflllsm which Is 
said to have clouded the profesilon. 

The Changing Nature of Practice s 

Whatever Its past may have bean, the practice of pharmacy is changing 
rapidly. The phamaeist la no longer simply a fabricator and dispenser of 
drugs. Thia traditional function has passad from the practitioner to the mam 
facturer and, more recently, pharmacy educators have been advocating a new 
role varloualy defined in the literature as "clinical pharmacist,'' 
"therapeutic adviser," or even "clinical pharmacologist" (16) (29) (2) (18). 
Whatever the name used,. and In spite of the minor differences in the functloni 
proposed, In all definitions it Is emphasized that the pharmacist must be 
available to provide precise Information on medications to enquiring health 
personnel and patients (30), In short, this new role would establish the 
pharmacist as a "drug information specialist," The implementation of this 
new role la a major eoncern of the profession for while some hospitals have 
aucceasfully placed pharmaciats on nursing units and on ward rounds with 
physlclana (23) , the process of change has been alow. Moreover, studies have 
shown that health prof essionals tend to seek drug information from sources 
other than pharmacists (30) (23). 

A number of studies have revealed that pharmaclfltfl are able to provide 
the factual drug informations but lack consulting skills although several 
studies Buggest that knowledge deficiencies msy exist <23) (24). Since mo it 
of these Btudies are dtfietlve vlth reapect to researeh pfocedurea, no firm 
O cdneiusions can ba drawn. Most writers agree that an important vehiclt for 
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helping phmrmaelsts to assume this new role Is continuing education • 



NEED FOR CONTINtJING EDUCATION 

In pharmaey, eontinulng education refers to that phase of professional 
edueatlon which begins "after the practitioner has received his basic educatlonp 
uaually a Bachelor of Science or a Doctor Pharmacy degree, ©r after he has 
completed a progrra devoted to advancement in a particular area of his base 
education t usually a ^taster of Science or , more rarelyp a Doctor of Philosophy 
degree and /or a hospital pharmacy residence*" It's purpose, "is to provide 
a practitioner learner with knowledge , skills, attitudes i and insights, that 
will continue to increapa hla capacities and Improve his professional confidence 
in rendering patient care" (12) , 

As in the other health professional the development of continuing 
education is relatively recent In pharmacy^ Blockatein (7) and others (14) (9), 
trace Its beginnings to the Pharmaceutical Survey of 1948 (7) which brought 
the university pharmacy schools into the malnstreMi of continuing education 
actlvltlei. Its recommendations relative to institutions of higher learning 
were I 

It is recornraended that each of the accredited colleges and 
schools of pharmacy recognise and assume responsibility for 
providing organiEed programs of In'^service professional 
instruction of the practising pharmacists within the area 
normally served by the institution, and to this end set up* 
under competent , professional direction » an operation. unit 
to be known as the "division of pharmaceutical extension t" 

It is recoimended that the duties of such divisions of 
pharmaceutical eKtension Include the development of refresher 
courses conducted at the Institutions, programs of reading 
correspondence study courses, and the systematic visitation 
and personal counselling of pharmaclstSi 

It is reeomended, in order to insure the maximum cooperative 
effort I that the state boards of phaTOacy of each state tak 
initiative for the creation In the state of a Fharmaceutleal 
EKtension Council consisting of the dean of the collega(s) 
Of schpolCs) of pharmacy I the director (s)^^^^e the dlvlaion(s) 
of pharoaceutlcal axteneioti and representatives of the state 
pharmaceutical association and the st^^ 

publieXinBtruction# 
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In response to these fecomaendatlons a number of pharaaQy aehoola Bvm 
reported to have established continuing mdueatlon programit and the concapt 
of eontinulng education as a responsibility of the pharmacy schools gained 
In popularity p albeit slowly • - 

In 1955, the American Association of the College of Pharmaey (hereinafter 
referred to as the AACP) , established a Gomslttee on Continuation Studlee. 
Its purpose was to "study the problems of continuing education , make recommenda- 
tions to the AACFf and to serve as a co^unlcation media among the member 
schools" (9), The annual reports Issued between 1957 and 1967 have consisted 
largely of brief quantitative sunmaries of educational activities reported by 
member schools and conn^enta with regards to reported problems. As early as 
19575 the Committee recommended that a study be undertaken to determine the 
nature and scope of continuing education In pharmacy, yet It was not until 
1967 that such a survey was actually undertaken (22), 

The findings of this study reflect some progress where comparative 
data are available. Nevertheless , a more recant report by the Committee (37) 
concludes s 

It is difficult to find anyone who is satisfied with the present 
state of continuing education for pharmacists « Without impugning 
the fine efforts of some Individuals p colleges p and associations 
it is fair to state that more significant and successful continuing 
education programs are needed to help the practising phafmaclsts 
who are confronted by an ever Increasing body of knowledge and by 
constantly changing conditions affecting their professional 
practice. • lit should be appreciated that the colleges must sponsor 
and direct the efforts needed to find solutions to the ever- 
present problems of continuing education , a low level of partlcl^ 
patlon. Inadequate or unsuitable prdgramSp and insufficient financial 
support ■ 

This review of the literature from 1960 to 1970 pTOved equally 
unrewarding. Only thirty three references were found which related to 
eontlnuiiig eduoation In phamacy» and of these, only seven were of a researchi i 

ERIC- - s-' -v-: ■ _ I 



295 

or mor# correctly, survey nature. 

Of the reports loeatedp probably the most useful source of information 
for those developing eontinulng education programs, are the proceedings of 
national conferenced held by the Teachers' Section on Continuing Education 
vof the AAGP. These have been published In the American Journal of Pharaaceutical 
Education since 1964* i 
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C^TER XVI 
PARTICIPATION IN CONTINUING EDUCATION 

Fharaaey has bmen the last of the major health professions to engage 
In the continuing edueatlon of Ite mmmbera. This involvement is of such recent 
origin that it is not genarally recognized or accepted by either practising 
pharmmclsts or by universities. Consequently ^ there is a paucity of literature 
dascrlblng the extent of opportunities for continuing education or the acceptance 
of these opportunities by the profession. 

Braucher (9) surveyed flfty^flve colleges of pharmacy In the United 
Statey and gatherad data about their progrMs in continuing education which 
gives some Indication of participation by pharmacists. In presenting his datap 
Braucher indicates the number of pharmacists who were "promoted" or solicited 
to participate In courses and the number who actually attended* From these 
data he computes a partlelpatloa Index that is an interesting and curious 
statistic. In one respect this Inde^c Is a measure of the percentage of the 
potential population that actually participated and| In another sense, it la an 
IndeK of Interest In continuing education and assessment of the effectiveness of 
the promotional activities of the sponsoring agencies (Table I 1) , 

Braucher 's data covers two years and while there is generally an 
increase In 1968 over 1967, this is too short a period of time to Indicate any 
trend toward Increasing participation in continuing education by pharmacists* 
Between 1967 and 1968 there was an Increase of 30i57 percent In the total 
number of participuts in all courses reported. Furthermore^ there was an 
increase from 3 •64 perMnt to 7,31 percent In the percentage of the target 
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populatioti that partlelpated. 

Uhen employtDBnt Is eonslderedy eoidmunlty phartaaolsts showed an Increase 
in part Iclpat ion of 11.56 percent, hospital pharmaplsts Iner^asad 2S*46 percent p 
and thqss pharaaclsts clasglfled as mixed Increased participation by 44.71 
perQent* On the other handp Industrial pharmacists showed a deeline of 23«76 
peraMt • 

In 1967 j the courses sponsored by pharmacy schools alone attracted 1.87 
percent more participants than courses co-sponsored with associations but in 
1968 the eo^sponsored courses eKceeded the school courses by Si* 6 percent « This 
suggasts that the aaaociatlons were a force In promoting courses* This is 
born out by the participation IndeK computed by Braucher which shows 11*95 pereeilt 
in 1968 compared with the schools IndeK of 4.22 percent in the same year. 

The participation index shows a decline In participation by community 
pharmacists but an increase In all other classes between 1967 and 1968. Indust- 
rial pharmacists had a greater Increase in the participation index than did any 
other class. 

When Braucher's data for 1967 is compared with thit reported by Jobe 
(22) for 1966 p there is a decrease of 7.8 percent but an increase of 20.38 percent 
in 1968 • The concern is eKpressed by some in the profession that continuing 
education may be reaching the s^e group and that those most in need of continuing 
education may not be participating (8) (32). 

^SONS FOR AtTENPINQ QR NOT 

The three major obstacles to partialpatlon identified by respondents 
in the Purdue study (32) werei the difficulty of finding registered personnel 
to relieve the pharmaaim during his absenc<i| loss of Income relative to time 
away from work $ and geographlaal distance from the locatign of progruiSp in that 
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order. While dlstanee wag elted as an Impoiftafit ofasCaQle by almoet dtie 
quarter of the respondentaf the school o£ pharmacy at Purdue conducts programs 
In local co^unltles; furtherniore * four of the eight regpondants living In 
the vicinity of the campus admitted to not having attended a program on campUBt 
This study alfip found that whllm 80 percent of the owners of pharmacies 
expressed a wllllngnees to defray eKpenaes for aQiployees, only 5 percent of 
the employee respondenta had had their expenses paid to attends Deflcleneles 
in the program were also rated as an Important deterrent to attendance. The 

most frequently cited weaknesg of prograas was their similarity. 
^ Subject matter was the moat important reason for attending while a 

well known apeaker was rated second^ and conference location third. The 

inclusion of social events in continuing education sessions was not found to be 

a major factor influencing the dacision to attend, 

Scheduline of Programs I ^ 

Polls indicate that pharmacists prefer one day sessions (19) (32) , 
however, studies discloee that longer courses scheduled Intermittently in the 
evenings are also favoured by a relatively large percentage of respondents 
(17) (19), In an earlier survey In the state of Mississippi, two to three day 
courses ware rated highly , despite the obstacles to attendance (IT), 

Fees g 

According to the respondents In the Purdue survey , a reasonable fee 
for a single session was considered to be between $5.00 and $l4«00p but fees 
were not seen as a major detenfrent to attendance. 

Felt Learning Needs s 

A number of surveys and reports suggest that despitm a wide variety 
Of toplca raquestedy phamacists tend to rate business management subjects 
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relatively high (13) (32) (19) (17). At least two surveya reveal thmt in the 
science area the greatest learning needs relate to pharmaceutical advances and 
pharmacology (19) (32), Bernardl (5) reports that in Connecitlcut pharmacists 
are Increasingly requesting courses on physiology. Other topics which have 
been asked for frequently are Interprofessional relationships and the effect 
of legislation on phaniacists (8) (19), Wien respondents ware asked to offer 
further suggestions In the Purdue study p. professional topics were requested far 
more often than business matters but with scientific subjects almost completely 
Ignored . 

Ingtructional PrQcesaes g 

The Hlsslsslppi survey (17) found that 64 percent preferred the lecture 
technique. Less than 10 percent wanted participative laboratory courses ^ but 
43.7 percent of the respondents did eKprsss an Interest In demonstrations ^ which 
may indicate theft pharmacists desire to learn and observe new techniques. In 
this study ^ 18.4 percent selected correspondence as the preferred means of 
keeping up to date. Other studies provide evidence that phamaclsts would like 
opportunities to engage In Independent study (13) (4). Tape recordings on 
pertinent topics have been cited as a method which would obviate the need to 
leave work in order to keep up to date. A recent evaluation of a corrsspondence 
course reported by Barnes (3) revealed that pharmacists rated >correspondence 
study highly p with older pharmacists most responsive. • 
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CHAfTER XVII 
PEOGR^ ORGANIZATION ^ID ^MINISTI^TIOK 

A numb er of Institutions and organisations are presently Involved In 
the eontlnultig education of pharmacists. Theae Include i The ^erlcan 
Society of Hospital Fharmaeista, the Canadian and American Hoapltal Aaaoclatlons 
university schoole or coliegas of pharmaQy and medicine ^ and pharmaeautical 
aseoQlations at all l^vels^ — ^n&tional, state or provincial p and local. However, 
the primary spansois of formal programs are the university schools of pharmacy* 

CmSWT COURSE OFFERINGS 

There is very little descriptive data available about the eKtent of 
continuing education in phaniacy ed that It la not possible to show changes 
over time with any validity. Braucher (9) has supplied virtually the only 
^substantive data available and this covers the period of 1966 to 1968 so it is 
not sufficient to show positive trends. Courses conducted by Schools of 
Pharmacy during this thrse year period show a slight increase from 109 in 1966 
* to 145 in 1968. Iftlle most of these courses were offered on campus ^ the trend 
to more off campus courses is evident^ In 1966| 68.80 percent of the courses 
offered were on campus but this declined to 46.89 percent In 1968. In 1967, 
the use of television was introduced with 13.04 percent of the courses in 
1967 and 17*93 percent in 1968 offered through that media. As the nimber of 
* courses incraase the average length of the course declined from 9*51 contact 
hours in 1966 to 8, 92 contact hours in 1968. (Ta^leiri) 
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Braucher also reports the number of couraes offered jointly by Schools 
of Phsraaey and Profeasional Afieoclatlons for tha same three year period* 
Joint sponsorship of this aort shows no conilstency and no Identifiable trends. 
In 1966 there were 145 jointly sponsored courses wlch 117 In 1967 and 138 in 
1968* These data suggest a decline in joint sponsdrshlp. The location of 
courses jointly eponsored is equally variable with 85,31 percent off campus In 
1S66 but 69*56 percent In 1968. The average number of hours per course tended 
to show an increase from 5*40 In 1966 to 6.90 In 1968 (Table IV). 

In comparing jointly sponsored courses with those conducted solely by 
echoole of pharmacy » several differences are noted. Courses conducted by schools 
are held on campus more frequently and tend to be longer than are those jointly 
sponeorad. School courses on cdmpus have Increased In length between 1967 
and 1968, while Jointly sponsored courses on campus have declined in length 
over the same period* On the other hand, school sponsored off --campus courses 
were shorter In 1968 than In 1967, while jointly sponsored off-cfflnpua courses 
did not change In length. In both Instances, off campus, courses are shorter 
than those on campui. Although the schools of pharmacy have eKperlmented more 
with television, jointly aponsored television courses have been longer. 

The subject most often presented la pharmacology, with an Increase of 
approKlmately 50 percent In the number of courses offered on this subject between 
1967 and 1968. Subject matter dealing with community pharmacy showed a slight 

Increase of some 16 percent. Although the ntmber of courses on public health 

^ j 

Increased between 1967 and 1968, clearly course offerings on this very Important 
subject are still soall. It is also worth noting that no course was offered 
on dental health in 1968 and only one eourse offered in 1967 (Table v) t 
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ADMINISTRATION 

The 1962-63 Report of the itaerlcan College of Pharmaeautical Education 
disclosed that In 1962, thirteen eolleges of pharmacy had Ixtenelon depart- 
ments. Of this nuinberp three reported a full time person In charge, while 
nine had a part time director, with two colleges reporting an additional part 
time person, and three reporting full time clerical staff (27). 

A more recent report covering the academic y^ar 1967^68 revealed little 
change » with only eight of the 74 colleges reporting a full time director In 
continuing education or extension and only nineteen a part time person. The 
majority of continuing education pregrMs sponsored by the colleges are 
managed by faculty who have responsibilities elsewhere <1) which may account 
for the relatively few courses available. 

Finances and Faculty ; 

As in the other health professions, funds are of prime concern in 
continuing pharmaceutical education. In 1966, registration fees made up about 
45 percent of the total revenue, and in 1968, some SO percent. The second 
major source of funds In 1968 was grant money used to aubsldlge courses (9), 
Although dapartments of continuing pharmaceutical education which are part 
of state universities are In a more stable position financially, generally 
speaking universities have not allocated tauch money to continuing education* 
Since regular faculty members who psftlclpate In continuing education progr^s 
are usually not paid, this limits the choice of Instructors (34)* 

Although phaTOaceutlcal firms have proylded large aims for the develop*?* 
ment af experimental projects In continuing medical eduaatlon, they have not 
beeQ a significant source of fwds for continuing pharmaceutical education. 
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Furthermore I government grants to support continuing education have been 
minimal # A riumbar of writers express the view that pharmacy has lacked an 
organized approach In its efforts to obtain additional funding , and they 
reeonmend 1) establishment of central statewide continuing education offices 
to co-ordinate programs » pool resources ^ and to seek fundi i 2) Implemcmtatlon 
of programs within the MDPSi and 3) Inclusion ©f a research component In the 
program propoaal^ thereby ensuring potential sponsors momB tangible results 
from the funds granted (21) (34). 

Promotion and Publicity i 

Promotion and publicity for continuing education in pharraacy have 
utilized the well established methods of direct mailing, professional associ-- 
ation bulletins, calendars, newspapers, and professional journals (27). The 
University of Wisconsin department le one eKception as it publishes a special 
periodical which Includes, In addition to current course offerings, papers 
from university programs as well as articles and reports from journals which 
are not always available to practitioners (36) « 

An Interesting technique that combines promotion with program planning 

is reported in use at the University of Colorado^ OTilte (38) noted i 

1. A list of "proposed seminar topics" la sent to the students 
through their aseoclation. The participants indicate in 
which topics they are Interested. They also indicate which 
night and what time schedule they prefer. 

2» These are returned to the school of pharmacy, and a seminar 
schedule is made up « 

3. Students are registered for the seminar by the Bureau, and fees 
are collected, , .The Bureau also makes eiipense payments to the 
school and to individuals « 

4i Outlines for each session are prepared by the faculty member 
in charge of the evening class and these are made available to 
the students, 

Sm At tha last seasion the students make a the seminar, 

and ottendance cartif Icatas are presented to the students (36) , 
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SOME SAMPLE PROG^^IS 

While continuing education In pharmacy is reported using a wide 
variety of methode and teehnlquea, Che typical program is said to be a 
confereneep institute » or short coursap all thvmm of which consist of a 
aaries of lectures either on a wide variety of subjacts or focussing on 
several aspects of a single theme (32) (14) (6) . Ot the few prograns 
mantloned in the literature, the following exmples illustrate the mora 
Innovativa approaches currently in use in continuing phanaaceutlcal education. 
Regional ProgramB t 

The Kansas School of Pharmacy has been canductlng statewide circuit 
type courses for many years. At present, four such programs are being offered 
in four places throughout the state , with the specific location varying for 
each circuit. In this way more rural phanpiacistB are able to participate in 
planned programs of continuing education (38)^ 

For the past several years the American Society of Hospital Phamacists 
(ASHP) has been sponsoring a centrally planned^ regionally Implemented eight 
to ten week preceptotship progrm^ designed to orientate conmunlty pharmacists 
to institutional practice. Organized on an Intermittent basis one half to one 
day weekly p this course combines classroott study with clinical practice^ In 
1969 McConnell (25) reported that more than 2^000 cotraiunlty phaMaclsts had 
participated In the progrui« 

Mass Media s 

As part of the university U extension service, the phsTOacy progrm 
at the University of Wisconsin is using telelectures. The first series of such 
lectures was offered In Ifareh and April 1966* and attracted 180 viewers for 
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each program. An svaluation of this series revealed an overwhalmlngly favour* 
abla reaponiei consequently. In May 1966 a sacond series was offered on 
Institutional Pharaaey, utilizing a wide variety of speakers, ineludlng a nurse 
who discussed the nurse -s role in the administration of aedicatlons, A 
questionnaire survey revealed that this program was regarded as eKeellent by 
the Majority of fespondents- Telelectures reach 47 loeatlons throughout the 
State of Wiseonsin and have attraeted an enthusiastic response* 

TOe college of pharmacy at the Unlvarsity of Hinnesota has been using 
closed circuit television with direct feedback by telephone since 1967 • The 
initial program^ presented to three areas on three successive Monday evenings , 
attracted an interested audience so the project was extended. Subsequent 
programs have used pre-taped lectures but with the lecturer present in the 
studio for the question and answer period. In 1968, Hodapp (20) reported 
that the audience was made up of physicians , pharmacists t drug company repre-* 
sentatlves, and nurses. Comaents from participants disclosed that the inter- 
disciplinary mix was felt to be a valuable learning experience. One 
questionnaire evaluation revealed that while 52 percent of the pharaaeidt 
respondents thought the subject was covered in proper depthp 75 percent of the 
nurses felt it was covered in too much depths 

Other states reported using television include New Torfcs North and 
South Dakota, Indiana , and Oklahoma (7). 

Home Study I 

The highly successful correspondence courses designed by Barnes at the 
St. Louis College of Pharmacy are said to have pioneered the use of correspon- 
dence as an Instructional method in continuing phamaceutical education (27). 
A nimber of colleges are repprt offering corrafipondence course.^ (9) t amd 
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these appear to be widely used both by course sponeors as adjuncts to short 
courses and by practitioners as a method of Independent study (4) • 

More recently^ programmed Instruction is making its way Into pharma- 
ceutical continuing education. North Eastern University in Boston, Massachuset 
la reported developing self-contained units and eKperlmental courses (28) « 

ISSUES mP TRENPS 

A recurring theme In the literature ©n continuing pharmaceutical 
education is the reported apathy or lack of irottvatlon of practising pharTnaclu^i 
to continue their professional education. The question of how to reach the 
great number of practitioners who are presently not being reached has been 
widely discussed from many points of view* 

A national survey conducted In 1963 of State pharmacy boards Invest le- 
gated their authority to make continuing education a condition for practice. 
Of the responding boards 36 felt that they were not so empowered, 9 felt they 
ware, and 7 were uncertain (11)* Since that study ^ at least two states have 
made participation in continuing education mandatory (8), and In 1968 , the 
Committee on Continuation Studies recommended that a study be undertaken to 
determine the feasibility of making continuing education mandatory on a 
national basis (37) • Because there are as many valid arguments for as against 
such a proposal, pharaacy remains divided on the issue (26). At the same 
time, paralleling the increased pressure from govertmemts to make periodic 
re-llceniure of health professionals compulsory, most of the pharmacy colleges 
and professional associations are presently ra-^assesslng their contiauing 
education role and activities in the field* 
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CHAPTER XVIII 
SUMIARY 

The most slgnlfleant development lii the pharmacy profession In the 
pait decade has bsan m. ehange In the role of tfie pharmaclat« With the transfsr 
of drug production from the local pharmacy to an Industrial establlehinent , 
the traditional role of the pharmacist as a compounder of drugs is rapidly 
disappearing* In its place is emerging a new role that places the pharmacist 
as the drug expert on the health care team. This emerging role is not 
campletely recognised or accepted by the profession because it detnanda know» 
ledge and skills of a different sort than that with which the pharmacist has 
been equipped in hi^' pra-prof esslonal education. To assume a new rolep then, 
pharmacists must acquire new and different knowledge through continuing 
education « . ' 

Neither individual pharmacists nor^ their institutions or associations 
have long considered continuing education to be a matter of importance* Con* 
sequently» there has been little done to provide programs for the further 
education of the profession. The lack of interest and eoneern in continuing 
education is amply illustrated by the paucity of literature on the subject 
as well as the almost total absence of any relevant research about continuing 
education in pharmacy. The scanty literature that has been produced is too 
nebulous and inconsistent to allow for any very reliable description of 
programs p administration « or participation in continuing education* 

Only a vary small percentage of the mmbers of the profession parti- 
cipatii rmgularly in plam^ programs of continuing edUQation* This results 
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from both Individual and professional factors* Individuals are deterred 
from participation by the loss In salary entailed as a rasult of being away 
from work and those who are entrapreneurs face the problem of securing a 
legally qualified person to substitute for them in their pharmacy. 

The profession p through its associations and the schools of pharmacy, 
has failed to provide adequate opportunities for continuing education* This 
failure stems largely from a lack of interest In and concern for the continuing 
education of the profession. Add to these a lack of knowledge about how to 
provide educational opportunities and a lack of fundmaental knowledge derived 
from research about the profession and its need for or acceptance of continuing 
education* As this review has shown , when the associations and the schools 
work together to provide educational opportunities, the response is enhanced 
so they need tp become more deeply committed and Involved, 

The drug Industry has provided support for research and eKperimentatlon 
in continuing education for other of the health professions but there is little 
evidence that It has done so for its owi professional groups This may well 
be due to their not having been pressed to do so by the pharmacy profession. 

University schools of pharmacy have the greatest stake in continuing 
education for the profession since education In phaniacy Is their sole ralson 
d '^tre t Although they have been Involved to some eKtent in continuing education 
this appears to have occurred with some reluetanee and certainly without 
creative leadership, Tha university schools of pharmacy have done virtually 
no research to provide a basis for programs and such that has been done 
suggests that eontlnulng education has made but a minimal Intact upon the 
practice of phariMcy because the Imowledge essential to functional p 
plarining has not been acquired^^t 
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pharmacist changes , so must the form^ content , and duration of edueation in 
pharmacy. In the literature reviewed there was no evidence to indicate an 
awareness of this in the schools* 

Of the several health professions p pharaacy is the most backward with 
rBspact to continuing education* The profession must be aroused to the need 
far it to ensure the survival of pharaacy as a profession. 
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GI^TER XVIII 
EPILOGUE 

Continuing education In the four major haalch profesalons has 
beeome a matter of growing concam that somewhat belatadly follows 
the naed to k^ap abreast of eKpandlng knowledge and the demand for 
better health care. Amons these four profeaslons studied , medlelna 
la far In the lead with reapect to the quantity of educational activ- 
ities available to the membere of that profeaslon* It is followed in 
turn by nursings dent la try, and pharmacy in that order. Each of these 
fields has approached continuing eduQatlon differently with respect to 
the acceptance of the need for education ^ the raaourcea conmlttad to 
itp and the kinds of learning actlvltlaa provided. 

In none of the professions is there evidence of a real cbm- 
mitment to continuous learning by Its members nor is there any sub— 
stantlal evidence of a real understanding of the educational process* 
The activities made available tend to be too few In number to meet 
the need^ too badly distributed to be generally available , and too 
pporly planned and conducted to insure that learning does in faeC 
occur. : MedlQlne has consistently COTmltted proportionately more re- 
sources to continuing education than have the other health professions 

*^^^si^S ^PP^ars to be more sensitive to the educational process 
as it applies to continuing education programs. Furthermore ^ there 
has been little rasearch in any health prof esslon to find the extent to 
ii^ich eKls t Ing programs affect ^ the prac 1 1cm g£ thm mCTbWrs " of the profea 



PAJITICIPATION 



Studies of partlelpation in continuing eduGatlon aGtlvltles 
indlQaCe that the members of the several prafesslona are not deeply 
eommltted to learning in order to maintain their professional know^ 
l#dge and skill* Partlelpation rates vary among the four professions 
and within eaeh* The varlatlpn within a profession appears to be 
related to the degree of specialisation of the mwbers. On the whole, 
the rata of partlelpation falls short of that CDnaldered essential by 
the leadership of the professions* 

Individual partlelpation tu continuing education Is a matter 
of the attitude and motivation of the Individual as well as the rele^ 
vancy of the programs available* , 
Attitudes g ' 

The formal school experience of adults develop attitudes about 
learning that tended to become a barrier to participation in continuing 
education* The normal pattern of sehoollng is designed to terminate 
at various points commensurate with an Individual's life goals and 
vocational expeetations • As a result , individuals do not recogniee 
or accept the Idea that education must continue throughout life In 
order to maintain some reasonable adjustment with a rapidly changing 
world i 

Tha health professions reinforce and in fact I accentuate this 
terminal concept of education by the ways in which the professions are 
structured. Admission to the profession is the ..terminal point In ed» 
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ucatlon for many membera although those with higher expectations may 
aet new terminal points in certain specializations or for apecifie 
positions in the profession. Thua, the attitude that education is 
terainal is reinforced to the point where it mltigatas against partic- 
ipation in education continuoualy • 

The prevelance of this concept of education has plagued adult 
education as Kidd noteai 

Thie teCTiinal coneept has long stood in opposition to the more 
creative idea that education is Inherently an -open-ended' pro- 
cess which can never bd definitely complete as long as life 
lasts} and that wherever on the ladder one* a achooling may have 
' terminated % there still rraalns an as yet unused capacity for 
mental and spiritual growth. The need and the capacity for 
education not only continues throughout life but actually In- 
creases as the Individual matures p provided that the eapaclty 
to learn is persistently exercised. 

Prior school eKperlencea have also tended to develop rigid and 
restrictive attitudes about the nature and form of education and learning. 
From elementary school through university , education has been structured 
in set patterns of courses, classes ^ and subjects In which the learner 
has been Involved only passlvaly with emphasis on the acquisition of 
information* Consequantly ^ activities are rejected if they fall outside 
the rangi! p£ traditional sehool experiences, b«caufle ^^1^ have 

J*®*' '° Both those who plan progrMas for continuing 

.education as well as potential pflrtloipantB are Inhibltad by theie resttlc= 
tlve Gonceptfl about education* 
Motivation ; ' 

The notivation to participate is frequently governed by the 
achievenent goals of an Individual.. The B true tu^^ 
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tends to restrict or reduce the ootlvation to participate so that only 
those motivated by personal satlef action are apt to partlclpata In 
further education after they have reached their terminal educational 
objective. 

The growing Interest in limited licensure in the health pro- 
fessions la thought to be an incentive for InQreaeed participation 
In continuing education* This does little more than set recurrent 
terminal polnta that will undoubtedly motivate Indlvlduali to partic*= 
Ipate in programa* ThuSp while It may increase attendance , lljiited 
licensure cannot automatically produce the learning that will lead to 
Improved practice* 

Axi individual may be motivated to attend a continuing ed- 
ucatloh program because of limited llcensurep but the motivation to 
engage in learning will develop only if the individual feels the need 
to learci and eKperiencea the aatlsf action resulting from successful 
learning. ThuSt the participation in education eeeentlal to improved 
practice will occur only through good learning experiences. 
Relevancy I 

Participation is Influenced by an Individual's perception of 
his need for learning so that he will be more apt to attend those 
activities that appear to be related to his needs and interests. The 
achievement of relevancy Is ^ therefore ^ crucial but It is inhibited 
by the fact that few individuals are capable of Identifying their need 
for learning accurately In functional terms. 
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In order to insure relevancy it is necessary to develop proced- 
ures for assessing the need for learning. The health prefeBBlons have 
not yet discovered aatlefactory ways of determining needB. Attempts to 
do BO through aelf-aseessment inventories succeed in helping to Identify 
information deflcienQles but these are not necessarily the real learning 
needs. Such Inventories operate on the as sumption that knowing leads 
automatically to doing but this is the most persistent fallacy in educa- 
tion* Thus, the Identification of Irif ©rmatlon deflcienQiee does not 
neeesaarlly apply to the real learning needs related to practice. 

The several health prefeeslonB have achieved little with rlsspect 
to understanding and solving the pioblMi of participation. Since the 
problem of participation in continuing education is so strongly Influ- 
enced by attltudeB /toward edueatlon, the basic Bolutlon to the problem 
will require a major change In pre-professlonal education programs and 
In the structurs of the professions to establish the concept of continue 
Ity In learning as a substitute for the present notion that education Is 
terminal. 



PROGRAMS 

The principal objective of continuing education In the health pro'?^ 
fesslons is the achlev^ent of the learning needed, to toprovfe patient care. 
The literature reviewed here presents scant evidence that this objective 
Is actually reached. It also suggests that aer tain rat©cpnoepC tons about 
education may be at the root of the trouble. 
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Planning i 

The four major health professions dlscusaed here have shoim 
some cfeatlylty in develpplng educatlQnal activities suited to their 
particular populations but these have been more the exaept ion than 
the nora« Host of the programs reported In the literature have adhered 
to the traditional patterns characteristic of Bchoollng and the specific 
objectives are rarely identified. Wiather stated specifically or not^ 
the objectives have been almost eKeluslvaly related to the acquisition 
of Information* It is apparent that there is little awareness of the 
importance of Identifying objectives as the flrat step in program 
planning. Consequently p most of the progrws reported attempted to 
cover too much material in the time available ^ were not directed to-* 
ward a clearly identified end, and could not be evaluated meaningfully* 
Only by astabllshing precise and uncomplicated objectives is it possible 
to plan useful programs » select content^ choose appropriate Instruction- 
al techniques , and measure the achievement of learning. 
Instruction I 

Nearly all of the progrws discussed in the literature used 
instructlnnal processes that are effective primarily for the diffusion 
of information with the lecture being the most, frequently used technique. 
None of the reports indicated any awareness ,of the desirability of se- 
lect ing instructional teehnlquas to fit the program objectives and the 
material to be learned. Furthemore, there was little indication that 
progrui Instructors did more than act as Instrumente for the diffusion 
of^ information, ' 
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To aceompllgh learnlni effeatlvely and efficiently It Is neQ« 
essary to manage lemrnlng^ This Involvea tha ssleetlon and arrangemmt 
of a sequence of events which the learner must be guided through and 
provided knowledge of the results of his efCorts, This guidance of 
learning Is the responsibility of the instructor who must have knowledge 
about the conditions affecting learning and the ability to plan the se^ 
quence of events through which beaming occurs* This management function 
appears to be one of the weakest aspects of continuing education In the 
health professions. 

RESEARCH 

Most of the published material about continuing education In ^ 
the health professions la exhortative. None of the professions have 
produced any substantial body of research useful In developing this 
aspect of the prof eeslon* Medicine has produced the largest volume of 
literature and phanaacy the least. . 

Although each profession has certain unique characteristics 
that make it necessary to conduct specific research ^ there Is mucli 
that Is conmion to all of the health professlbns and to all adult ed- 
ucation. Because of this j Interprofessional research into continuing 
education would be more economical as well as beneficial to all of the 
prpfepsionSf There Is little evidence In the literature to Indicate 
that the prof asslons know or have used relevant research about adult 
learning and InstrucClon that has been produced outside the profession. 
Greater use of such existing research would enable each profession to 
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concentrate on its own unique questions , 

Most^ of the research litaratura is descriptive in that it re- 
ports programs and procedures used in providing opportunitiee for con- 
tinuing education for a particular population. This is most useful for 
the general spread of innQvative program ideas hut it Qontrihutaa little 
to the advancement of knowledge ^ Such reports can be enhanced by mora 
complete information about objectives , instructionj the characteristics 
of the population y and similar data to permit an analysis of the pro- 
gram and the results aQhlaved* 

The survey method has been predomlnmnt in the studies ravlei^ed. 
In most cases t this has suffered from inadequate sampling procedures 
^nd controls along with incomplete data processing. As a result, the 
flndlnigs are not necessarily valid or reliable^ consequently the basic 
data needed to plan and Qonduct continuing education activities for the 
several professions Is not yet available^ 

Very little analytical research that tests relevant hypotheses 
or seeks to answer crucial questions has been done. As this kind of 
research Incraasas it will acaelerate the accu 

knowledge .ibout continuing education in ths several health professions. 

CODA 

Although this review of the literature Indicates that there is 
little room for complacency about continuing education in the several 
health prof ess lofi's , it does show clearly a rapidly growing interest In 
and conasm for the quality md extent of educational opportunities » 




The design and conduct of educational actlvltiee for adults Is Itself 
a specialised body of knowledge and skill comparable to that required 
to practice in any of the health professions discussed hare. It Is 
unusual Indeed to find Individuals equally equipped for a health pro- 
feseion and for adult education. That this must aventually come to 
pass is Inevitable, ThuSp the initiation of improvements in continuing 
education for the health professions must begin with the development of 
personnel lirithin each profession for whom adult education is an area of 
speciall^atlQn equal to those now graerally recognized and accepted by 
the professions. 
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